Jul 29 01:09:25.859788 ip-10-0-137-249 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:09:26.304479 ip-10-0-137-249 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:26.304479 ip-10-0-137-249 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:09:26.304479 ip-10-0-137-249 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:26.304479 ip-10-0-137-249 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:09:26.304479 ip-10-0-137-249 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:09:26.307785 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.307618    2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:09:26.314533 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314497    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:26.314533 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314536    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314543    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314546    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314550    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314553    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314556    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314559    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314561    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314565    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314568    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314570    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314573    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314576    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314578    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314581    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314583    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314588    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314593    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314596    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:26.314663 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314599    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314602    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314605    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314608    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314610    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314613    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314615    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314618    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314621    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314624    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314627    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314629    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314632    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314635    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314638    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314641    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314644    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314647    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314649    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314652    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:26.315121 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314655    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314657    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314661    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314664    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314667    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314669    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314672    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314674    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314677    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314680    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314683    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314685    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314688    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314690    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314693    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314695    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314698    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314701    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314704    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314706    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:26.315693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314709    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314712    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314714    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314717    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314719    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314722    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314724    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314729    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314732    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314734    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314737    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314739    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314742    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314746    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314749    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314751    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314754    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314759    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314763    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:26.316171 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314766    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314768    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314773    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314776    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314780    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314783    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314786    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314789    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314791    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314794    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314797    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314799    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314802    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314804    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314807    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314809    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314812    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314814    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314817    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:26.316642 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.314820    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315561    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315569    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315572    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315574    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315577    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315580    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315583    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315585    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315588    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315591    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315593    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315596    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315598    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315601    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315603    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315606    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315609    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315613    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315617    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:26.317100 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315619    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315624    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315627    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315630    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315633    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315635    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315638    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315641    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315644    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315646    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315649    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315651    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315654    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315657    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315660    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315662    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315665    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315668    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315670    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:26.317608 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315673    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315676    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315678    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315682    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315684    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315687    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315689    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315692    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315694    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315697    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315700    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315703    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315706    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315709    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315711    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315714    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315716    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315719    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315721    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315724    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:26.318113 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315726    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315730    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315734    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315737    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315740    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315743    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315746    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315749    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315752    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315755    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315757    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315760    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315762    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315765    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315767    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315770    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315772    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315775    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315778    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:26.318632 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315780    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315783    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315785    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315788    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315791    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315793    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315797    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315799    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315802    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315804    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315806    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315809    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315812    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315814    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315817    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315819    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315821    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315824    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315826    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315829    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:26.319094 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315832    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.315835    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316215    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316219    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316222    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316225    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316228    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316230    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316233    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316236    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316239    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316242    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316245    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316247    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316250    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316253    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316255    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316258    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316261    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316264    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:26.319612 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316267    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316269    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316272    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316275    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316277    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316280    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316282    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316287    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316290    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316293    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316296    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316299    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316302    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316304    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316307    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316310    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316314    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316316    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316318    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:26.320122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316321    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316323    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316326    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316329    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316331    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316334    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316337    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316342    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316345    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316347    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316350    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316352    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316355    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316358    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316360    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316363    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316366    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316369    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316373    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316375    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:26.320607 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316378    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316381    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316383    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316385    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316388    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316391    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316393    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316397    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316400    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316402    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316405    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316407    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316410    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316413    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316415    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316418    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316420    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316423    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316425    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316430    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:26.321098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316432    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316435    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316437    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316440    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316444    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316448    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316451    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316454    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316457    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316460    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316463    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316466    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316469    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316472    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316474    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316477    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316480    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316482    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316485    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:26.321591 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316487    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316490    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.316492    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316581    2557 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316589    2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316595    2557 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316600    2557 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316604    2557 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316607    2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316611    2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316616    2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316619    2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316623    2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316627    2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316630    2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316633    2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316636    2557 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316639    2557 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316642    2557 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316646    2557 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316649    2557 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316653    2557 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316657    2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:09:26.322048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316662    2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316665    2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316668    2557 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316672    2557 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316675    2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316678    2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316681    2557 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316684    2557 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316687    2557 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316689    2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316692    2557 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316695    2557 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316700    2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316703    2557 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316706    2557 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316708    2557 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316711    2557 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316714    2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316719    2557 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316722    2557 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316725    2557 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316729    2557 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316732    2557 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316735    2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:09:26.322646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316738    2557 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316741    2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316744    2557 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316747    2557 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316750    2557 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316753    2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316756    2557 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316759    2557 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316764    2557 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316767    2557 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316771    2557 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316774    2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316777    2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316780    2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316783    2557 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316785    2557 flags.go:64] FLAG: --help="false"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316789    2557 flags.go:64] FLAG: --hostname-override="ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316792    2557 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316795    2557 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316797    2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316801    2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316804    2557 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316807    2557 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:09:26.323269 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316810    2557 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316813    2557 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316816    2557 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316818    2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316822    2557 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316824    2557 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316827    2557 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316830    2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316833    2557 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316836    2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316839    2557 flags.go:64] FLAG: --lock-file=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316841    2557 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316844    2557 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316847    2557 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316852    2557 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316856    2557 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316859    2557 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316863    2557 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316866    2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316869    2557 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316871    2557 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316874    2557 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316879    2557 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316882    2557 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316886    2557 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:09:26.323906 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316889    2557 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316891    2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316894    2557 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316897    2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316900    2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316903    2557 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316905    2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316913    2557 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316916    2557 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316919    2557 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316921    2557 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316924    2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316931    2557 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316934    2557 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316937    2557 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316940    2557 flags.go:64] FLAG: --port="10250"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316943    2557 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316946    2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00522c7fd380c8912"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316949    2557 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316952    2557 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316955    2557 flags.go:64] FLAG: --register-node="true"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316957    2557 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316965    2557 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316970    2557 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:09:26.324539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316973    2557 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316977    2557 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316980    2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316983    2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316986    2557 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316989    2557 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316992    2557 flags.go:64] FLAG: --runonce="false"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316995    2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.316998    2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317001    2557 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317003    2557 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317006    2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317009    2557 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317012    2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317016    2557 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317018    2557 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317021    2557 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317024    2557 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317027    2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317029    2557 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317032    2557 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317035    2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317040    2557 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317043    2557 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317046    2557 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:09:26.325140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317050    2557 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317052    2557 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317055    2557 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317058    2557 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317061    2557 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317064    2557 flags.go:64] FLAG: --v="2"
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317067    2557 flags.go:64] FLAG: --version="false"
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317071    2557 flags.go:64] FLAG: --vmodule=""
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317076    2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317080    2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317189    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317193    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317195    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317198    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317201    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317203    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317206    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317208    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317211    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317213    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317216    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317218    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:26.325758 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317221    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317224    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317227    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317229    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317232    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317234    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317238    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317241    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317243    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317246    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317248    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317251    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317254    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317256    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317259    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317262    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317264    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317267    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317271    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317274    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:26.326289 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317276    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317279    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317281    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317284    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317286    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317289    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317291    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317294    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317296    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317299    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317301    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317304    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317307    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317309    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317311    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317314    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317317    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317319    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317324    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317326    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:26.326808 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317329    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317331    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317334    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317338    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317341    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317345    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317348    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317351    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317353    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317356    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317361    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317364    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317366    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317369    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317372    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317375    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317377    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317380    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317382    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:26.327329 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317385    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317387    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317390    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317393    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317395    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317398    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317400    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317403    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317405    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317409    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317413    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317417    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317420    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317422    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317425    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317428    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317431    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317433    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317436    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317438    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:26.327823 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317441    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317443    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317447    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317451    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317454    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317461    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317464    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.317468    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.317473    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.324358    2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.324373    2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.324391    2557 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.324397    2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324462    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:26.328322 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324466    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324469    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324473    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324477    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324481    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324484    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324487    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324490    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324493    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324495    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324498    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324501    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324503    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324506    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324509    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324511    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324514    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324533    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324537    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:26.328779 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324540    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324542    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324545    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324548    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324551    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324554    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324556    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324559    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324562    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324567    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324569    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324572    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324575    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324577    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324580    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324583    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324585    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324588    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324591    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324594    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:26.329241 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324596    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324599    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324601    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324604    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324606    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324609    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324613    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324617    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324619    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324622    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324624    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324627    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324630    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324632    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324635    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324637    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324641    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324645    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324648    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:26.329770 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324651    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324654    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324658    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324661    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324665    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324668    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324670    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324673    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324677    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324679    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324682    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324684    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324687    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324689    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324692    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324694    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324697    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324700    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324702    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:26.330292 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324705    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324708    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324710    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324713    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324715    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324718    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324721    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324724    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324726    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324729    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324731    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324734    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324736    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324739    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324742    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324745    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324747    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324751    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324754    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324756    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:26.330819 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324759    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.324764    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324903    2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324908    2557 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324911    2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324913    2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324916    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324918    2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324921    2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324924    2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324926    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324929    2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324931    2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324934    2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324936    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:09:26.331304 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324939    2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324941    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324943    2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324946    2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324948    2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324951    2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324953    2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324955    2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324958    2557 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324960    2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324964    2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324968    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324970    2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324973    2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324976    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324984    2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324987    2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324990    2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324992    2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:09:26.331700 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324995    2557 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.324998    2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325000    2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325003    2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325005    2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325008    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325011    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325013    2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325016    2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325019    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325021    2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325024    2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325026    2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325029    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325037    2557 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325039    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325042    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325045    2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325047    2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:09:26.332146 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325051    2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325054    2557 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325057    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325060    2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325062    2557 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325065    2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325067    2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325070    2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325072    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325075    2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325083    2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325085    2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325088    2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325090    2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325093    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325095    2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325097    2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325100    2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325102    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325106    2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:09:26.332654 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325109    2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325111    2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325114    2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325116    2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325119    2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325121    2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325123    2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325126    2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325129    2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325131    2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325134    2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325136    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325138    2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325141    2557 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325144    2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325146    2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325149    2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325151    2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325154    2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325157    2557 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:09:26.333190 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325160    2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325162    2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325165    2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325174    2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325177    2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325179    2557 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325182    2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:26.325184    2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.325189    2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.325305    2557 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.328334    2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.330060    2557 server.go:1019] "Starting client certificate rotation"
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.330169    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:09:26.333693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.330211    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:09:26.334011 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.333010    2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:09:26.336120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.336098    2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:09:26.344194 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.344172    2557 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:09:26.346377 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.346360    2557 log.go:25] "Validated CRI v1 image API"
Jul 29 01:09:26.347236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.347218    2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:09:26.350591 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.350570    2557 fs.go:135] Filesystem UUIDs: map[65e75e42-6dfb-403e-81d1-6fe30424868e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9ff1cdbc-1f78-4c07-9225-e4b6478aed7d:/dev/nvme0n1p3]
Jul 29 01:09:26.350647 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.350591    2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:09:26.356062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.355939    2557 manager.go:216] Machine: {Timestamp:2026-07-29 01:09:26.354482952 +0000 UTC m=+0.367187043 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101652 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec250957544bc6067998f9eb7cb4b7c0 SystemUUID:ec250957-544b-c606-7998-f9eb7cb4b7c0 BootID:f8eeae5a-48c8-4fd9-8525-24114fe589b5 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c8:cb:09:46:b5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c8:cb:09:46:b5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:00:8c:31:a4:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:09:26.356062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.356050    2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:09:26.356203 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.356123    2557 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:09:26.356824 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.356807    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:09:26.359463 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.359435    2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:09:26.359618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.359466    2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:09:26.360770 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.360760    2557 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:09:26.360804 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.360775    2557 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:09:26.360804 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.360783    2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:09:26.361577 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.361566    2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:09:26.362624 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.362613    2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:09:26.364527 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364507    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:09:26.364673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364662    2557 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:09:26.364715 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364696    2557 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:09:26.364715 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364708    2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:09:26.364769 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364732    2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:09:26.364769 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364742    2557 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:09:26.364769 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.364752    2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:09:26.365109 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.365098    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:09:26.365155 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.365117    2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:09:26.368014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.367997    2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:09:26.370263 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.370246    2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:09:26.370352 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.370285    2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:09:26.372210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372195    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372216    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372225    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372233    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372246    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372255    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372267    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372275    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:09:26.372288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372285    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:09:26.372573 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372294    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:09:26.372573 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372314    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:09:26.372573 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.372323    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:09:26.373743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.373730    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:09:26.373804 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.373745    2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:09:26.376513 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.376488    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:09:26.376859 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.376757    2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:09:26.376969 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.376912    2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:09:26.377750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.377729    2557 server.go:1268] "Started kubelet"
Jul 29 01:09:26.378461 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.378438    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j4p75"
Jul 29 01:09:26.378596 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.378567    2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:09:26.378616 ip-10-0-137-249 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:09:26.379391 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.378645    2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:09:26.379391 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.379318    2557 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:09:26.380975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.380954    2557 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:09:26.381308 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.381290    2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:09:26.385375 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.385340    2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:09:26.386637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.386620    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-j4p75"
Jul 29 01:09:26.388219 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.387168    2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c69d669eef6213  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-29 01:09:26.377693715 +0000 UTC m=+0.390397807,LastTimestamp:2026-07-29 01:09:26.377693715 +0000 UTC m=+0.390397807,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 29 01:09:26.391913 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.391893    2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:09:26.392004 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.391896    2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:09:26.392077 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.392037    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.392514 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.392496    2557 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:09:26.392514 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.392515    2557 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:09:26.392671 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.392496    2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:09:26.392671 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.392623    2557 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:09:26.392671 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.392631    2557 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:09:26.393305 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393227    2557 factory.go:55] Registering systemd factory
Jul 29 01:09:26.393305 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393256    2557 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:09:26.393902 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393887    2557 factory.go:153] Registering CRI-O factory
Jul 29 01:09:26.393902 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393905    2557 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:09:26.394047 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393956    2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:09:26.394047 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393975    2557 factory.go:103] Registering Raw factory
Jul 29 01:09:26.394047 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.393987    2557 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:09:26.395134 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.395121    2557 manager.go:349] Starting recovery of all containers
Jul 29 01:09:26.403651 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.403624    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:26.405416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.405316    2557 manager.go:354] Recovery completed
Jul 29 01:09:26.406409 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.406391    2557 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.409488 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.409476    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.411145 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.411129    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.411196 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.411167    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.411653 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.411639    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.412152 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.412135    2557 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:09:26.412152 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.412149    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.412280 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.412151    2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:09:26.412280 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.412239    2557 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:09:26.414216 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.414197    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.414286 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.414234    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.414286 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.414249    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.414374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.414363    2557 policy_none.go:49] "None policy: Start"
Jul 29 01:09:26.414404 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.414379    2557 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:09:26.414404 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.414391    2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:09:26.415712 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.415700    2557 policy_none.go:47] "Start"
Jul 29 01:09:26.453230 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453210    2557 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.453252    2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453265    2557 server.go:87] "Starting device plugin registration server"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453551    2557 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453565    2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453645    2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453781    2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.453791    2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.454316    2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:09:26.469739 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.454367    2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.494140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.494107    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:09:26.495253 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.495226    2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:09:26.495334 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.495281    2557 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:09:26.495334 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.495308    2557 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:09:26.495415 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.495350    2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:09:26.497622 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.497601    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:26.554655 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.554565    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.555548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.555514    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.555618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.555561    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.555618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.555572    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.555618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.555597    2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.563813 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.563796    2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.563880 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.563821    2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-249.ec2.internal\": node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.585988 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.585964    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.595571 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.595547    2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"]
Jul 29 01:09:26.595655 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.595618    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.597251 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.597231    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.597338 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.597261    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.597338 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.597273    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.598828 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.598815    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.598942 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.598928    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.598984 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.598968    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.599888 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.599873    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.599953 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.599894    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.599953 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.599913    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.599953 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.599923    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.600052 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.599899    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.600052 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.599982    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.601131 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.601116    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.601176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.601142    2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:09:26.601829 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.601814    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:09:26.601897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.601835    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:09:26.601897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.601849    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:09:26.630062 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.630039    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.634221 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.634206    2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.686659 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.686639    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.693915 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.693898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1efdfff138f18e1d925713efe9be33ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"1efdfff138f18e1d925713efe9be33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.693979 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.693920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1efdfff138f18e1d925713efe9be33ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"1efdfff138f18e1d925713efe9be33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.693979 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.693938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c95cbfbb4ec054ca150d39d22684fb3d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"c95cbfbb4ec054ca150d39d22684fb3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.787780 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.787748    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.795078 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.795052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1efdfff138f18e1d925713efe9be33ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"1efdfff138f18e1d925713efe9be33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.795167 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.795088    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1efdfff138f18e1d925713efe9be33ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"1efdfff138f18e1d925713efe9be33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.795167 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.795115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c95cbfbb4ec054ca150d39d22684fb3d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"c95cbfbb4ec054ca150d39d22684fb3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.795263 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.795166    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c95cbfbb4ec054ca150d39d22684fb3d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"c95cbfbb4ec054ca150d39d22684fb3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.795263 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.795167    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1efdfff138f18e1d925713efe9be33ca-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"1efdfff138f18e1d925713efe9be33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.795263 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.795167    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1efdfff138f18e1d925713efe9be33ca-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"1efdfff138f18e1d925713efe9be33ca\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.888506 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.888442    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:26.933929 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.933902    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.939044 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:26.939028    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:26.989442 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:26.989408    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:27.089969 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:27.089945    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:27.190534 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:27.190433    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:27.291084 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:27.291051    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:27.329533 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.329491    2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:09:27.330066 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.329676    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:09:27.330066 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.329676    2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:09:27.391232 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:27.391202    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:27.392315 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.392277    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:04:27 +0000 UTC" deadline="2028-04-14 14:02:16.212632424 +0000 UTC"
Jul 29 01:09:27.392389 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.392317    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15012h52m48.820320157s"
Jul 29 01:09:27.458959 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:27.458928    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95cbfbb4ec054ca150d39d22684fb3d.slice/crio-7a7e729d747e73bcebb4d78dd5d2286108f3db5953e4701938b8af469621a503 WatchSource:0}: Error finding container 7a7e729d747e73bcebb4d78dd5d2286108f3db5953e4701938b8af469621a503: Status 404 returned error can't find the container with id 7a7e729d747e73bcebb4d78dd5d2286108f3db5953e4701938b8af469621a503
Jul 29 01:09:27.459370 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:27.459356    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1efdfff138f18e1d925713efe9be33ca.slice/crio-ca041aeaffbfd0a6a547ed80d1b92e65cabcbfb911259533b6356bcd61053bab WatchSource:0}: Error finding container ca041aeaffbfd0a6a547ed80d1b92e65cabcbfb911259533b6356bcd61053bab: Status 404 returned error can't find the container with id ca041aeaffbfd0a6a547ed80d1b92e65cabcbfb911259533b6356bcd61053bab
Jul 29 01:09:27.463574 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.463559    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:09:27.492245 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:27.492216    2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 29 01:09:27.498460 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.498414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"1efdfff138f18e1d925713efe9be33ca","Type":"ContainerStarted","Data":"ca041aeaffbfd0a6a547ed80d1b92e65cabcbfb911259533b6356bcd61053bab"}
Jul 29 01:09:27.499415 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.499389    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" event={"ID":"c95cbfbb4ec054ca150d39d22684fb3d","Type":"ContainerStarted","Data":"7a7e729d747e73bcebb4d78dd5d2286108f3db5953e4701938b8af469621a503"}
Jul 29 01:09:27.541197 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.541176    2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:27.593194 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.593157    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:27.600455 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.599366    2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:27.603817 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.603801    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:09:27.604920 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.604906    2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 29 01:09:27.612777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:27.612762    2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:09:28.366067 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.366034    2557 apiserver.go:52] "Watching apiserver"
Jul 29 01:09:28.373139 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.373101    2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:09:28.374465 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.374433    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr","openshift-cluster-node-tuning-operator/tuned-sdljn","openshift-dns/node-resolver-b2s9f","openshift-image-registry/node-ca-cz9m2","openshift-multus/multus-fczdg","openshift-network-operator/iptables-alerter-vf6fc","openshift-ovn-kubernetes/ovnkube-node-844xt","kube-system/global-pull-secret-syncer-rp7rc","kube-system/konnectivity-agent-sntmb","kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal","openshift-multus/multus-additional-cni-plugins-6dqtv","openshift-multus/network-metrics-daemon-rdb8t","openshift-network-diagnostics/network-check-target-krrvc"]
Jul 29 01:09:28.376420 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.376397    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.378150 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.378130    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:28.378246 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.378204    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:28.379560 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.379325    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.379560 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.379390    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:09:28.379697 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.379671    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:09:28.380347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.379958    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:09:28.380347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.379977    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-28lgg\""
Jul 29 01:09:28.380347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.380107    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.380347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.380126    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:09:28.380347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.380215    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.381874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.381730    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.382336 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.382189    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.382433 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.382335    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xrpdj\""
Jul 29 01:09:28.384103 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.383771    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.385992 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.385968    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.386298 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.386254    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6gxx7\""
Jul 29 01:09:28.386495 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.386476    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.386604 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.386488    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:09:28.386731 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.386705    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.388323 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.388298    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.389356 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.388903    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.389356 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.388922    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.389356 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.389160    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vp67g\""
Jul 29 01:09:28.389556 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.389372    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:09:28.389556 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.389376    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:09:28.389892 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.389868    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.394121 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.394098    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.394247 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.394207    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z47m8\""
Jul 29 01:09:28.394349 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.394330    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.394485 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.394467    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:09:28.394690 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.394672    2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:09:28.394755 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.394719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.395428 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.395407    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:09:28.396225 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.396205    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-scs94\""
Jul 29 01:09:28.397004 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.396914    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:09:28.398062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.397453    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.398062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.397467    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.398062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.397494    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ccsx7\""
Jul 29 01:09:28.398062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.397601    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:09:28.398479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.398459    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.400231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.400213    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:28.400435 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.400414    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:28.400747 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.400584    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:09:28.400747 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.400630    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x9zmc\""
Jul 29 01:09:28.401050 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.400903    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:09:28.402444 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402352    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.402444 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.402410    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:28.402971 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402838    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxxwp\" (UniqueName: \"kubernetes.io/projected/b9f15f19-5d1e-4223-b23b-e0a52f56af72-kube-api-access-vxxwp\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.402971 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-hosts-file\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.402971 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402896    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-k8s-cni-cncf-io\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.402971 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402919    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-hostroot\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.402971 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402942    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-modprobe-d\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.403254 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.402990    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa2132b6-4237-4623-b3d5-2edb9cda7062-tmp\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.403254 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403127    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-ovnkube-script-lib\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.403254 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403157    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06f86dae-013a-478c-8bf0-87ee98afd542-agent-certs\") pod \"konnectivity-agent-sntmb\" (UID: \"06f86dae-013a-478c-8bf0-87ee98afd542\") " pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.403254 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403181    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-socket-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.403254 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403208    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-kubernetes\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.403511 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403492    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.403673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403650    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvfqq\" (UniqueName: \"kubernetes.io/projected/fa2132b6-4237-4623-b3d5-2edb9cda7062-kube-api-access-rvfqq\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.403737 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403690    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-systemd\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.403737 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403717    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-log-socket\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.403836 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403741    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f15f19-5d1e-4223-b23b-e0a52f56af72-host\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.403836 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403763    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-ovnkube-config\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.403836 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403788    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk52q\" (UniqueName: \"kubernetes.io/projected/13af7f9d-6acb-46c4-9217-22928315571b-kube-api-access-hk52q\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.403836 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403817    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7scdd\" (UniqueName: \"kubernetes.io/projected/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-kube-api-access-7scdd\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403844    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-cni-multus\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-multus-certs\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403877    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysctl-conf\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403906    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-daemon-config\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.403980    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysconfig\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404004    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysctl-d\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404044    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-var-lib-kubelet\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404067    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-kubelet\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404090    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-run-netns\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404110    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-node-log\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404144    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmlq\" (UniqueName: \"kubernetes.io/projected/363a46f9-103e-46a4-bb6c-046dad08bd7b-kube-api-access-mbmlq\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-kubelet\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404196    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-systemd\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404218    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-host\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404284    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404318    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06f86dae-013a-478c-8bf0-87ee98afd542-konnectivity-ca\") pod \"konnectivity-agent-sntmb\" (UID: \"06f86dae-013a-478c-8bf0-87ee98afd542\") " pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.404366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404359    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzknc\" (UniqueName: \"kubernetes.io/projected/cc406cce-394d-4c5c-a594-5b910b3ae36c-kube-api-access-qzknc\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404383    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-ovn\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404408    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-tuned\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404430    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-systemd-units\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404463    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-cni-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-os-release\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404530    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-cni-bin\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404556    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-var-lib-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404578    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-tmp-dir\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-system-cni-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404621    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-netns\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404642    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9f15f19-5d1e-4223-b23b-e0a52f56af72-serviceca\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404665    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404687    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-sys-fs\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-cnibin\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404730    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-etc-kubernetes\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404751    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-lib-modules\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.404981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404773    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13af7f9d-6acb-46c4-9217-22928315571b-ovn-node-metrics-cert\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404795    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404822    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-slash\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404865    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-env-overrides\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404898    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-device-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7zx2\" (UniqueName: \"kubernetes.io/projected/a94992d8-2cf6-4e16-afac-1b396aef3f65-kube-api-access-h7zx2\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.404960    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-registration-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc406cce-394d-4c5c-a594-5b910b3ae36c-cni-binary-copy\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-conf-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405051    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a94992d8-2cf6-4e16-afac-1b396aef3f65-iptables-alerter-script\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht2m5\" (UniqueName: \"kubernetes.io/projected/3e6d744d-8d4e-4697-89a2-7b343e495e0d-kube-api-access-ht2m5\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405120    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-sys\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405162    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-socket-dir-parent\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405199    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a94992d8-2cf6-4e16-afac-1b396aef3f65-host-slash\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405220    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-run\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405241    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-etc-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.405772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405265    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-run-ovn-kubernetes\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.406583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405299    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-cni-bin\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.406583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.405328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-cni-netd\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.406583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.406144    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:09:28.406583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.406346    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:09:28.406583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.406460    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g8spf\""
Jul 29 01:09:28.412306 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.412282    2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:09:28.434112 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.434071    2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdmwb"
Jul 29 01:09:28.442093 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.442070    2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mdmwb"
Jul 29 01:09:28.493428 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.493399    2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506187    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-run-netns\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506226    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-node-log\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506252    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmlq\" (UniqueName: \"kubernetes.io/projected/363a46f9-103e-46a4-bb6c-046dad08bd7b-kube-api-access-mbmlq\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-run-netns\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506279    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-kubelet\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-node-log\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506334    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-kubelet\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506348    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-systemd\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.506380 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506374    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-host\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506396    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506421    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506443    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06f86dae-013a-478c-8bf0-87ee98afd542-konnectivity-ca\") pod \"konnectivity-agent-sntmb\" (UID: \"06f86dae-013a-478c-8bf0-87ee98afd542\") " pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506469    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506483    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-host\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-cnibin\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506552    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzknc\" (UniqueName: \"kubernetes.io/projected/cc406cce-394d-4c5c-a594-5b910b3ae36c-kube-api-access-qzknc\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506577    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-ovn\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506612    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-systemd\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506655    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-tuned\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506682    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-systemd-units\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506714    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c8345ad-6415-492b-9916-99eb34c04ae8-kubelet-config\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506738    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-cni-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506742    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-ovn\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506754    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-os-release\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506713    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506794    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-cni-bin\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506817    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-var-lib-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506839    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-tmp-dir\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-system-cni-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506872    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-netns\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.506987    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9f15f19-5d1e-4223-b23b-e0a52f56af72-serviceca\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507035    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-sys-fs\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507059    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507070    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-netns\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507084    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c8345ad-6415-492b-9916-99eb34c04ae8-dbus\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507098    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/06f86dae-013a-478c-8bf0-87ee98afd542-konnectivity-ca\") pod \"konnectivity-agent-sntmb\" (UID: \"06f86dae-013a-478c-8bf0-87ee98afd542\") " pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507109    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-cnibin\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507132    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-os-release\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507136    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-etc-kubernetes\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507181    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-system-cni-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507239    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-systemd-units\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507277    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-var-lib-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.507840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507281    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-sys-fs\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507284    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-cnibin\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-cni-bin\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507338    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507357    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-cni-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507383    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-lib-modules\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507411    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13af7f9d-6acb-46c4-9217-22928315571b-ovn-node-metrics-cert\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507449    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-slash\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507533    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-lib-modules\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507536    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-env-overrides\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-device-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507584    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-tmp-dir\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507596    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-slash\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507613    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-device-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-etc-kubernetes\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.508749 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.507686    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507688    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507727    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7zx2\" (UniqueName: \"kubernetes.io/projected/a94992d8-2cf6-4e16-afac-1b396aef3f65-kube-api-access-h7zx2\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.507772    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:29.007737807 +0000 UTC m=+3.020441904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507816    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-registration-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507842    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc406cce-394d-4c5c-a594-5b910b3ae36c-cni-binary-copy\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-conf-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a94992d8-2cf6-4e16-afac-1b396aef3f65-iptables-alerter-script\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507112    2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfv5m\" (UniqueName: \"kubernetes.io/projected/1ff7510b-be57-4da4-aba2-442d0b4bff26-kube-api-access-xfv5m\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507947    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht2m5\" (UniqueName: \"kubernetes.io/projected/3e6d744d-8d4e-4697-89a2-7b343e495e0d-kube-api-access-ht2m5\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507972    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-sys\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.507995    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-system-cni-dir\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508002    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-env-overrides\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508020    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-socket-dir-parent\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508057    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a94992d8-2cf6-4e16-afac-1b396aef3f65-host-slash\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.509636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508059    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-registration-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508079    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-run\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508101    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-etc-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508101    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-conf-dir\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-run-ovn-kubernetes\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508190    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-etc-openvswitch\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508192    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a94992d8-2cf6-4e16-afac-1b396aef3f65-host-slash\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508245    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-cni-bin\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508279    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-cni-netd\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508289    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-run\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508255    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-sys\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508306    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxxwp\" (UniqueName: \"kubernetes.io/projected/b9f15f19-5d1e-4223-b23b-e0a52f56af72-kube-api-access-vxxwp\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508332    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-hosts-file\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508341    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-run-ovn-kubernetes\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508342    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-cni-bin\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508355    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-k8s-cni-cncf-io\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508372    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-cni-netd\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508395    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc406cce-394d-4c5c-a594-5b910b3ae36c-cni-binary-copy\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.510448 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508419    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a94992d8-2cf6-4e16-afac-1b396aef3f65-iptables-alerter-script\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-socket-dir-parent\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508450    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-k8s-cni-cncf-io\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508469    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-hostroot\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508481    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-hosts-file\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508495    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-modprobe-d\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508539    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa2132b6-4237-4623-b3d5-2edb9cda7062-tmp\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508551    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-hostroot\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508563    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-ovnkube-script-lib\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508584    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06f86dae-013a-478c-8bf0-87ee98afd542-agent-certs\") pod \"konnectivity-agent-sntmb\" (UID: \"06f86dae-013a-478c-8bf0-87ee98afd542\") " pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508607    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-socket-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508613    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9f15f19-5d1e-4223-b23b-e0a52f56af72-serviceca\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508632    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-kubernetes\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-modprobe-d\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvfqq\" (UniqueName: \"kubernetes.io/projected/fa2132b6-4237-4623-b3d5-2edb9cda7062-kube-api-access-rvfqq\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508683    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-systemd\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508693    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-kubernetes\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508705    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-log-socket\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.511304 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508726    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f15f19-5d1e-4223-b23b-e0a52f56af72-host\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508731    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-socket-dir\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508753    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508780    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-ovnkube-config\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508805    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk52q\" (UniqueName: \"kubernetes.io/projected/13af7f9d-6acb-46c4-9217-22928315571b-kube-api-access-hk52q\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508829    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-os-release\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7scdd\" (UniqueName: \"kubernetes.io/projected/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-kube-api-access-7scdd\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508881    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-cni-multus\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508907    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-multus-certs\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508919    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-run-systemd\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508928    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysctl-conf\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508952    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508971    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9f15f19-5d1e-4223-b23b-e0a52f56af72-host\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.508976    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509012    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-daemon-config\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509016    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-var-lib-cni-multus\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509046    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysconfig\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.512154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509071    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysctl-d\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509096    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-var-lib-kubelet\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509120    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-kubelet\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509183    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-host-kubelet\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509254    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/13af7f9d-6acb-46c4-9217-22928315571b-log-socket\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509306    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/363a46f9-103e-46a4-bb6c-046dad08bd7b-etc-selinux\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509346    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysctl-d\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509387    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysconfig\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509425    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-sysctl-conf\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509431    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa2132b6-4237-4623-b3d5-2edb9cda7062-var-lib-kubelet\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509444    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-ovnkube-config\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc406cce-394d-4c5c-a594-5b910b3ae36c-host-run-multus-certs\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/13af7f9d-6acb-46c4-9217-22928315571b-ovnkube-script-lib\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.509874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc406cce-394d-4c5c-a594-5b910b3ae36c-multus-daemon-config\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.511937    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fa2132b6-4237-4623-b3d5-2edb9cda7062-etc-tuned\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.512086    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/13af7f9d-6acb-46c4-9217-22928315571b-ovn-node-metrics-cert\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.513017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.512811    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa2132b6-4237-4623-b3d5-2edb9cda7062-tmp\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.513850 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.513829    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/06f86dae-013a-478c-8bf0-87ee98afd542-agent-certs\") pod \"konnectivity-agent-sntmb\" (UID: \"06f86dae-013a-478c-8bf0-87ee98afd542\") " pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.514397 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.514188    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmlq\" (UniqueName: \"kubernetes.io/projected/363a46f9-103e-46a4-bb6c-046dad08bd7b-kube-api-access-mbmlq\") pod \"aws-ebs-csi-driver-node-l5dzr\" (UID: \"363a46f9-103e-46a4-bb6c-046dad08bd7b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.516604 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.516542    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzknc\" (UniqueName: \"kubernetes.io/projected/cc406cce-394d-4c5c-a594-5b910b3ae36c-kube-api-access-qzknc\") pod \"multus-fczdg\" (UID: \"cc406cce-394d-4c5c-a594-5b910b3ae36c\") " pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.520251 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.520226    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk52q\" (UniqueName: \"kubernetes.io/projected/13af7f9d-6acb-46c4-9217-22928315571b-kube-api-access-hk52q\") pod \"ovnkube-node-844xt\" (UID: \"13af7f9d-6acb-46c4-9217-22928315571b\") " pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.520799 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.520659    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxxwp\" (UniqueName: \"kubernetes.io/projected/b9f15f19-5d1e-4223-b23b-e0a52f56af72-kube-api-access-vxxwp\") pod \"node-ca-cz9m2\" (UID: \"b9f15f19-5d1e-4223-b23b-e0a52f56af72\") " pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.520799 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.520759    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7scdd\" (UniqueName: \"kubernetes.io/projected/53ff96e0-5f44-4e0d-9d7d-db58f38cbc35-kube-api-access-7scdd\") pod \"node-resolver-b2s9f\" (UID: \"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35\") " pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.520964 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.520939    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht2m5\" (UniqueName: \"kubernetes.io/projected/3e6d744d-8d4e-4697-89a2-7b343e495e0d-kube-api-access-ht2m5\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:28.521037 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.520960    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7zx2\" (UniqueName: \"kubernetes.io/projected/a94992d8-2cf6-4e16-afac-1b396aef3f65-kube-api-access-h7zx2\") pod \"iptables-alerter-vf6fc\" (UID: \"a94992d8-2cf6-4e16-afac-1b396aef3f65\") " pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.523679 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.523658    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvfqq\" (UniqueName: \"kubernetes.io/projected/fa2132b6-4237-4623-b3d5-2edb9cda7062-kube-api-access-rvfqq\") pod \"tuned-sdljn\" (UID: \"fa2132b6-4237-4623-b3d5-2edb9cda7062\") " pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.529626 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.529606    2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:28.610180 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610180 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610183    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-os-release\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610213    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610248    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610264    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-cnibin\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610268    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-os-release\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610286    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c8345ad-6415-492b-9916-99eb34c04ae8-kubelet-config\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610336    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610340    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610344    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-cnibin\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610340    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c8345ad-6415-492b-9916-99eb34c04ae8-kubelet-config\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.610374 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.610360    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610364    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c8345ad-6415-492b-9916-99eb34c04ae8-dbus\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.610427    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:29.110406962 +0000 UTC m=+3.123111074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610484    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c8345ad-6415-492b-9916-99eb34c04ae8-dbus\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610485    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610574    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610600    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfv5m\" (UniqueName: \"kubernetes.io/projected/1ff7510b-be57-4da4-aba2-442d0b4bff26-kube-api-access-xfv5m\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-system-cni-dir\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610694    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1ff7510b-be57-4da4-aba2-442d0b4bff26-system-cni-dir\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.610890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.610874    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.611247 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.611019    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.611247 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.611045    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1ff7510b-be57-4da4-aba2-442d0b4bff26-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.619223 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.619167    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfv5m\" (UniqueName: \"kubernetes.io/projected/1ff7510b-be57-4da4-aba2-442d0b4bff26-kube-api-access-xfv5m\") pod \"multus-additional-cni-plugins-6dqtv\" (UID: \"1ff7510b-be57-4da4-aba2-442d0b4bff26\") " pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:28.620172 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.620152    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:28.620279 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.620176    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:28.620279 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.620189    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:28.620279 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:28.620249    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:29.120235727 +0000 UTC m=+3.132939824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:28.666858 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.666823    2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:09:28.689954 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.689929    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:28.708515 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.708491    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b2s9f"
Jul 29 01:09:28.717504 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.717480    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cz9m2"
Jul 29 01:09:28.722598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.722573    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fczdg"
Jul 29 01:09:28.730810 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.730790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vf6fc"
Jul 29 01:09:28.737897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.737879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:28.744821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.744805    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr"
Jul 29 01:09:28.752631 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.752612    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdljn"
Jul 29 01:09:28.758683 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:28.758664    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6dqtv"
Jul 29 01:09:30.034211 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.034127    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:30.034361 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.034246    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:30.034361 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.034316    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:31.034301187 +0000 UTC m=+4.026266833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:30.135440 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.135398    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:30.135616 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.135574    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:30.135674 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.135661    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:31.135635503 +0000 UTC m=+4.127601150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:30.236382 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.236345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:30.236575 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.236491    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:30.236575 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.236516    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:30.236575 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.236529    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:30.236735 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.236594    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:31.236575967 +0000 UTC m=+4.228541627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:30.338803 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.338777    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94992d8_2cf6_4e16_afac_1b396aef3f65.slice/crio-2652440dc224e0953dde508f5f253ea87b8b2c9dec1f0a7d1d1c5abcb5c84959 WatchSource:0}: Error finding container 2652440dc224e0953dde508f5f253ea87b8b2c9dec1f0a7d1d1c5abcb5c84959: Status 404 returned error can't find the container with id 2652440dc224e0953dde508f5f253ea87b8b2c9dec1f0a7d1d1c5abcb5c84959
Jul 29 01:09:30.353410 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.353380    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc406cce_394d_4c5c_a594_5b910b3ae36c.slice/crio-04c55672e5742074781ddff50f15013b09e1ba4e928bf5efa8b4e85be9a77551 WatchSource:0}: Error finding container 04c55672e5742074781ddff50f15013b09e1ba4e928bf5efa8b4e85be9a77551: Status 404 returned error can't find the container with id 04c55672e5742074781ddff50f15013b09e1ba4e928bf5efa8b4e85be9a77551
Jul 29 01:09:30.357543 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.357518    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff7510b_be57_4da4_aba2_442d0b4bff26.slice/crio-b77e538b77873c9a9f4401f919c326bd0934c173236f3362b0c98a391ef1da44 WatchSource:0}: Error finding container b77e538b77873c9a9f4401f919c326bd0934c173236f3362b0c98a391ef1da44: Status 404 returned error can't find the container with id b77e538b77873c9a9f4401f919c326bd0934c173236f3362b0c98a391ef1da44
Jul 29 01:09:30.358305 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.358196    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13af7f9d_6acb_46c4_9217_22928315571b.slice/crio-5eeedf02ae6928e0581d4b0f4a8b9ae58359f2e3c1eaa9c10130c2ed33f1ff23 WatchSource:0}: Error finding container 5eeedf02ae6928e0581d4b0f4a8b9ae58359f2e3c1eaa9c10130c2ed33f1ff23: Status 404 returned error can't find the container with id 5eeedf02ae6928e0581d4b0f4a8b9ae58359f2e3c1eaa9c10130c2ed33f1ff23
Jul 29 01:09:30.359709 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.359615    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f86dae_013a_478c_8bf0_87ee98afd542.slice/crio-2836a3c83642cb9895754d7652fa4f9c52a138b29ef3d30840bc602d2f2407e1 WatchSource:0}: Error finding container 2836a3c83642cb9895754d7652fa4f9c52a138b29ef3d30840bc602d2f2407e1: Status 404 returned error can't find the container with id 2836a3c83642cb9895754d7652fa4f9c52a138b29ef3d30840bc602d2f2407e1
Jul 29 01:09:30.360610 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.360560    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ff96e0_5f44_4e0d_9d7d_db58f38cbc35.slice/crio-ddbed157a5c797eec827b0f21f8eb93ed833694f7ad97768019c2093570add0e WatchSource:0}: Error finding container ddbed157a5c797eec827b0f21f8eb93ed833694f7ad97768019c2093570add0e: Status 404 returned error can't find the container with id ddbed157a5c797eec827b0f21f8eb93ed833694f7ad97768019c2093570add0e
Jul 29 01:09:30.361582 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.361559    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f15f19_5d1e_4223_b23b_e0a52f56af72.slice/crio-48bd4c5a2c4ab37e9ccbc470a8e7da9770f96fc4eb1356831675bdff9cc2f18c WatchSource:0}: Error finding container 48bd4c5a2c4ab37e9ccbc470a8e7da9770f96fc4eb1356831675bdff9cc2f18c: Status 404 returned error can't find the container with id 48bd4c5a2c4ab37e9ccbc470a8e7da9770f96fc4eb1356831675bdff9cc2f18c
Jul 29 01:09:30.362039 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.362017    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363a46f9_103e_46a4_bb6c_046dad08bd7b.slice/crio-4dc6a073f9e7dff1806b71961ff917bf722f34799e06fd0846c0bc36a0502c2b WatchSource:0}: Error finding container 4dc6a073f9e7dff1806b71961ff917bf722f34799e06fd0846c0bc36a0502c2b: Status 404 returned error can't find the container with id 4dc6a073f9e7dff1806b71961ff917bf722f34799e06fd0846c0bc36a0502c2b
Jul 29 01:09:30.363081 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:09:30.363060    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2132b6_4237_4623_b3d5_2edb9cda7062.slice/crio-a18df568c53105fade89a7b20b6248b22faafeb6102da35f03f606a5c0fbb2cc WatchSource:0}: Error finding container a18df568c53105fade89a7b20b6248b22faafeb6102da35f03f606a5c0fbb2cc: Status 404 returned error can't find the container with id a18df568c53105fade89a7b20b6248b22faafeb6102da35f03f606a5c0fbb2cc
Jul 29 01:09:30.465776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.465576    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:04:29 +0000 UTC" deadline="2028-05-13 22:21:35.56427844 +0000 UTC"
Jul 29 01:09:30.465776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.465776    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15717h12m5.098508376s"
Jul 29 01:09:30.516990 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.516960    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:30.517178 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:30.517089    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:30.524483 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.524449    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cz9m2" event={"ID":"b9f15f19-5d1e-4223-b23b-e0a52f56af72","Type":"ContainerStarted","Data":"48bd4c5a2c4ab37e9ccbc470a8e7da9770f96fc4eb1356831675bdff9cc2f18c"}
Jul 29 01:09:30.525738 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.525713    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr" event={"ID":"363a46f9-103e-46a4-bb6c-046dad08bd7b","Type":"ContainerStarted","Data":"4dc6a073f9e7dff1806b71961ff917bf722f34799e06fd0846c0bc36a0502c2b"}
Jul 29 01:09:30.526847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.526828    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"5eeedf02ae6928e0581d4b0f4a8b9ae58359f2e3c1eaa9c10130c2ed33f1ff23"}
Jul 29 01:09:30.528463 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.528443    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerStarted","Data":"b77e538b77873c9a9f4401f919c326bd0934c173236f3362b0c98a391ef1da44"}
Jul 29 01:09:30.529541 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.529521    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fczdg" event={"ID":"cc406cce-394d-4c5c-a594-5b910b3ae36c","Type":"ContainerStarted","Data":"04c55672e5742074781ddff50f15013b09e1ba4e928bf5efa8b4e85be9a77551"}
Jul 29 01:09:30.531412 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.531387    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" event={"ID":"c95cbfbb4ec054ca150d39d22684fb3d","Type":"ContainerStarted","Data":"26471a9124324b1b6a783b44d64bbf227e5535b054bbdeb8704d7492079301be"}
Jul 29 01:09:30.532583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.532555    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdljn" event={"ID":"fa2132b6-4237-4623-b3d5-2edb9cda7062","Type":"ContainerStarted","Data":"a18df568c53105fade89a7b20b6248b22faafeb6102da35f03f606a5c0fbb2cc"}
Jul 29 01:09:30.533688 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.533666    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2s9f" event={"ID":"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35","Type":"ContainerStarted","Data":"ddbed157a5c797eec827b0f21f8eb93ed833694f7ad97768019c2093570add0e"}
Jul 29 01:09:30.535547 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.535522    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sntmb" event={"ID":"06f86dae-013a-478c-8bf0-87ee98afd542","Type":"ContainerStarted","Data":"2836a3c83642cb9895754d7652fa4f9c52a138b29ef3d30840bc602d2f2407e1"}
Jul 29 01:09:30.536703 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.536682    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vf6fc" event={"ID":"a94992d8-2cf6-4e16-afac-1b396aef3f65","Type":"ContainerStarted","Data":"2652440dc224e0953dde508f5f253ea87b8b2c9dec1f0a7d1d1c5abcb5c84959"}
Jul 29 01:09:30.545837 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:30.545789    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" podStartSLOduration=2.5457735919999998 podStartE2EDuration="2.545773592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:30.545332102 +0000 UTC m=+3.537297770" watchObservedRunningTime="2026-07-29 01:09:30.545773592 +0000 UTC m=+3.537739295"
Jul 29 01:09:31.042922 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.042748    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:31.043087 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.042915    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:31.043087 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.042996    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.042973967 +0000 UTC m=+6.034939616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:31.143855 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.143737    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:31.144014 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.143980    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:31.144085 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.144053    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.144026396 +0000 UTC m=+6.135992047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:31.245292 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.244662    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:31.245292 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.244815    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:31.245292 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.244833    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:31.245292 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.244846    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:31.245292 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.244910    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:33.244892263 +0000 UTC m=+6.236857925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:31.466636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.466470    2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:04:29 +0000 UTC" deadline="2028-03-01 10:15:09.994444881 +0000 UTC"
Jul 29 01:09:31.466636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.466524    2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13953h5m38.527925029s"
Jul 29 01:09:31.517413 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.517385    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:31.517568 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.517505    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:31.517870 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.517846    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:31.517971 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:31.517943    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:31.564032 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.563993    2557 generic.go:356] "Generic (PLEG): container finished" podID="1efdfff138f18e1d925713efe9be33ca" containerID="6d051bd4784ae630410a260278f6da3b60cff3aa7d94e67f72d89f744e2c1e07" exitCode=0
Jul 29 01:09:31.564360 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:31.564326    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"1efdfff138f18e1d925713efe9be33ca","Type":"ContainerDied","Data":"6d051bd4784ae630410a260278f6da3b60cff3aa7d94e67f72d89f744e2c1e07"}
Jul 29 01:09:32.516566 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:32.516490    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:32.517020 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:32.516630    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:32.577792 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:32.577753    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"1efdfff138f18e1d925713efe9be33ca","Type":"ContainerStarted","Data":"b04f84fa9dffd3053c12ac731b779d3511307c3ae7d7a36db4aa6bce7b230738"}
Jul 29 01:09:33.064025 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:33.063991    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:33.064190 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.064140    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.064281 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.064204    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:37.064184225 +0000 UTC m=+10.056149897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:33.164779 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:33.164750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:33.165008 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.164901    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.165008 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.164964    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:37.164945043 +0000 UTC m=+10.156910695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:33.265426 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:33.265335    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:33.265598 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.265499    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:33.265598 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.265521    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:33.265598 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.265533    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.265598 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.265591    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:37.265574782 +0000 UTC m=+10.257540429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:33.517811 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:33.517313    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:33.517811 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.517446    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:33.518666 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:33.518479    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:33.518666 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:33.518582    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:34.517229 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:34.517192    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:34.517407 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:34.517368    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:35.516852 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:35.516519    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:35.516852 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:35.516647    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:35.516852 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:35.516751    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:35.517479 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:35.516915    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:36.517049 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:36.517007    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:36.517487 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:36.517161    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:37.099572 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:37.099530    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:37.099727 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.099688    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:37.099765 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.099758    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:09:45.099738973 +0000 UTC m=+18.091704634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:37.200881 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:37.200830    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:37.201056 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.201028    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:37.201119 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.201103    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:45.201083411 +0000 UTC m=+18.193049063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:37.301969 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:37.301893    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:37.302125 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.302034    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:37.302125 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.302056    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:37.302125 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.302068    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:37.302315 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.302131    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:09:45.30211166 +0000 UTC m=+18.294077318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:37.518431 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:37.517864    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:37.518431 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.517978    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:37.519166 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:37.519010    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:37.519166 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:37.519117    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:38.517204 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:38.517169    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:38.517398 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:38.517332    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:39.517026 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:39.517001    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:39.517526 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:39.516990    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:39.517526 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:39.517162    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:39.517526 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:39.517316    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:40.516420 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:40.516390    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:40.516596 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:40.516504    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:41.517023 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:41.516987    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:41.517505 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:41.517138    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:41.517505 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:41.517200    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:41.517505 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:41.517308    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:42.516236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:42.516204    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:42.516428 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:42.516341    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:43.516841 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:43.516803    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:43.517344 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:43.516946    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:43.517344 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:43.517000    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:43.517344 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:43.517114    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:44.517125 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:44.517089    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:44.517634 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:44.517230    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:45.162609 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:45.162570    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:45.162771 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.162741    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:45.162830 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.162818    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:10:01.162796248 +0000 UTC m=+34.154761910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:09:45.263327 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:45.263289    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:45.263512 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.263442    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:45.263588 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.263519    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:01.263496763 +0000 UTC m=+34.255462412 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:09:45.364347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:45.364304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:45.364512 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.364469    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:09:45.364512 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.364489    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:09:45.364512 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.364501    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:45.364628 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.364553    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:01.364539542 +0000 UTC m=+34.356505189 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:09:45.516915 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:45.516832    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:45.517061 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.516975    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:45.517061 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:45.516985    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:45.517177 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:45.517093    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:46.516338 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:46.516293    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:46.516514 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:46.516425    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:47.520459 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:47.520427    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:47.520917 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:47.520532    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:47.520917 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:47.520549    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:47.520917 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:47.520662    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:48.516308 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:48.516214    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:48.516379 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:48.516358    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:49.516950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.516717    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:49.517618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.516784    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:49.517618 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:49.517045    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:49.517618 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:49.517090    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:49.652180 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.652153    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sntmb" event={"ID":"06f86dae-013a-478c-8bf0-87ee98afd542","Type":"ContainerStarted","Data":"ae25f93f1cd53a1e6cb9a18f558a2f061eb4709c1d6193ec4a5b8ab0124ecb1f"}
Jul 29 01:09:49.653520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.653497    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cz9m2" event={"ID":"b9f15f19-5d1e-4223-b23b-e0a52f56af72","Type":"ContainerStarted","Data":"acd8da26b04674ac673447f88d04c1ca4531b6eb1663e56a2ba756764b6780bf"}
Jul 29 01:09:49.654847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.654820    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr" event={"ID":"363a46f9-103e-46a4-bb6c-046dad08bd7b","Type":"ContainerStarted","Data":"b21db8183d0b255beb05dee9591c5d544c31a24359bfc3777d3a0b5bbcc9be75"}
Jul 29 01:09:49.657560 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.657540    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"f41eb5c96c8ccdea531f38501ae719d2fdac9e0c91e6909863b21d5928189e77"}
Jul 29 01:09:49.657673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.657593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"07b13286d1d2d43741ca4dd4c41d68df691fde1ea57c3bad805c1a9a64c575f0"}
Jul 29 01:09:49.657673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.657636    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"0a39180305df79d43434f5d9ba8492fd2e4e241cc69171f7a88320cfa9d67747"}
Jul 29 01:09:49.657673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.657664    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"5f8547ec680095c4935ef590a7286659227dc89526ad0bc8c9b7753e9ded33c6"}
Jul 29 01:09:49.657819 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.657698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"8e8241d9b62e880ec95b8a52a5fb9f0051ceb87d0760fbfd4592049ee6eab0cf"}
Jul 29 01:09:49.657819 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.657725    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"fedd29cf84ec163ee1b490bded3f97ac5d9e86e87f11f4881a857ec0d5a0b37e"}
Jul 29 01:09:49.658861 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.658841    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ff7510b-be57-4da4-aba2-442d0b4bff26" containerID="f765ee6bb12baec55d39f1263d275bc4221249cc7cae842fcb5f0eaf98dc7561" exitCode=0
Jul 29 01:09:49.658950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.658903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerDied","Data":"f765ee6bb12baec55d39f1263d275bc4221249cc7cae842fcb5f0eaf98dc7561"}
Jul 29 01:09:49.660169 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.660150    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fczdg" event={"ID":"cc406cce-394d-4c5c-a594-5b910b3ae36c","Type":"ContainerStarted","Data":"3629187784dea7c1d66c58cb213ce07ddb94989df837b76a23a1365f405204ce"}
Jul 29 01:09:49.661445 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.661426    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdljn" event={"ID":"fa2132b6-4237-4623-b3d5-2edb9cda7062","Type":"ContainerStarted","Data":"c4c686c9275774da0bddbf53ab557c520777df923e7c0a199eb069b4bc137d05"}
Jul 29 01:09:49.662670 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.662649    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b2s9f" event={"ID":"53ff96e0-5f44-4e0d-9d7d-db58f38cbc35","Type":"ContainerStarted","Data":"59190f1b377346cbd58864f3cb8ee28f5b94e8ee06450beb55833f71280d9622"}
Jul 29 01:09:49.667623 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.667589    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sntmb" podStartSLOduration=4.5231666310000005 podStartE2EDuration="22.667577901s" totalImagesPullingTime="18.14441127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:49.667279261 +0000 UTC m=+22.659244926" watchObservedRunningTime="2026-07-29 01:09:49.667577901 +0000 UTC m=+22.659543569"
Jul 29 01:09:49.667700 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.667672    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" podStartSLOduration=21.667668634 podStartE2EDuration="21.667668634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:32.596339813 +0000 UTC m=+5.588305482" watchObservedRunningTime="2026-07-29 01:09:49.667668634 +0000 UTC m=+22.659634320"
Jul 29 01:09:49.696750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.696714    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b2s9f" podStartSLOduration=4.540560613 podStartE2EDuration="22.696703067s" totalImagesPullingTime="18.156142454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:49.682325392 +0000 UTC m=+22.674291059" watchObservedRunningTime="2026-07-29 01:09:49.696703067 +0000 UTC m=+22.688668810"
Jul 29 01:09:49.696831 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.696772    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cz9m2" podStartSLOduration=4.554196686 podStartE2EDuration="22.696767927s" totalImagesPullingTime="18.142571241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:49.696376424 +0000 UTC m=+22.688342082" watchObservedRunningTime="2026-07-29 01:09:49.696767927 +0000 UTC m=+22.688733594"
Jul 29 01:09:49.732139 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.732104    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sdljn" podStartSLOduration=4.591029395 podStartE2EDuration="22.732093532s" totalImagesPullingTime="18.141064137s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:49.732087302 +0000 UTC m=+22.724052970" watchObservedRunningTime="2026-07-29 01:09:49.732093532 +0000 UTC m=+22.724059196"
Jul 29 01:09:49.732265 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.732239    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fczdg" podStartSLOduration=4.52304407 podStartE2EDuration="22.732235318s" totalImagesPullingTime="18.209191248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:49.716616022 +0000 UTC m=+22.708581690" watchObservedRunningTime="2026-07-29 01:09:49.732235318 +0000 UTC m=+22.724201010"
Jul 29 01:09:49.879968 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:49.879944    2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:09:50.488797 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.488674    2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:09:49.879962039Z","UUID":"6a77b4ad-9808-4b33-9fa5-ae92db5ab917","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:09:50.490510 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.490490    2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:09:50.490720 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.490538    2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:09:50.516345 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.516310    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:50.516569 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:50.516446    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:50.667157 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.666937    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vf6fc" event={"ID":"a94992d8-2cf6-4e16-afac-1b396aef3f65","Type":"ContainerStarted","Data":"489b6ff26fb1ea71369c4fca100fcf90c218c63d60f33beaf5e91995f841e596"}
Jul 29 01:09:50.669454 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.669414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr" event={"ID":"363a46f9-103e-46a4-bb6c-046dad08bd7b","Type":"ContainerStarted","Data":"febc1b1a0bb33c42607455b370b922083b775d47c820097fa0fbc569e1d63b0e"}
Jul 29 01:09:50.927773 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.927693    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:50.928280 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.928236    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:50.945943 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:50.945893    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vf6fc" podStartSLOduration=5.784115376 podStartE2EDuration="23.945878048s" totalImagesPullingTime="18.161762672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:50.68119039 +0000 UTC m=+23.673156091" watchObservedRunningTime="2026-07-29 01:09:50.945878048 +0000 UTC m=+23.937843716"
Jul 29 01:09:51.517135 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.516883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:51.517313 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.516883    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:51.517313 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:51.517217    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:51.517313 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:51.517271    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:51.674840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.674802    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr" event={"ID":"363a46f9-103e-46a4-bb6c-046dad08bd7b","Type":"ContainerStarted","Data":"5abd7c4bd6092b40b2fca319ecab3354452d46af664ada626c54104c14e32ba0"}
Jul 29 01:09:51.679050 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.679009    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"dae02160877f4b8e4371b6f35e9260619114a235f0a7746eeac893287528ebda"}
Jul 29 01:09:51.679362 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.679334    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:51.679930 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.679901    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sntmb"
Jul 29 01:09:51.699236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:51.699178    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l5dzr" podStartSLOduration=4.494098616 podStartE2EDuration="24.699159951s" totalImagesPullingTime="20.205061335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:51.698860533 +0000 UTC m=+24.690826201" watchObservedRunningTime="2026-07-29 01:09:51.699159951 +0000 UTC m=+24.691125619"
Jul 29 01:09:52.516686 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:52.516653    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:52.516880 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:52.516760    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:53.516835 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:53.516800    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:53.516835 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:53.516838    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:53.517645 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:53.516919    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:53.517645 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:53.517059    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:54.516598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.516406    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:54.516779 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:54.516683    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:54.690568 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.690529    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" event={"ID":"13af7f9d-6acb-46c4-9217-22928315571b","Type":"ContainerStarted","Data":"d96a8a472a39f8659efe58c395909af437fe75ef9cf0ed37c35187c59bebaaf3"}
Jul 29 01:09:54.691210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.690889    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:54.692545 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.692506    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ff7510b-be57-4da4-aba2-442d0b4bff26" containerID="3e3d1cc1bee5985d5a10a3ab5e3e02ecd2a37ffaeb0e8cd120a82db4916c6c86" exitCode=0
Jul 29 01:09:54.692691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.692558    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerDied","Data":"3e3d1cc1bee5985d5a10a3ab5e3e02ecd2a37ffaeb0e8cd120a82db4916c6c86"}
Jul 29 01:09:54.707435 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.707407    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:54.719990 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:54.719934    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-844xt" podStartSLOduration=9.498477103 podStartE2EDuration="27.719919166s" totalImagesPullingTime="18.221442063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:09:54.71944891 +0000 UTC m=+27.711414581" watchObservedRunningTime="2026-07-29 01:09:54.719919166 +0000 UTC m=+27.711884834"
Jul 29 01:09:55.516826 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.516762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:55.517040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.516762    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:55.517040 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:55.516935    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:55.517040 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:55.516963    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:55.695777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.695740    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:55.696227 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.695834    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:55.710935 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.710902    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rp7rc"]
Jul 29 01:09:55.711121 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.711026    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:55.711178 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:55.711143    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:55.714575 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.714533    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:09:55.715024 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.714996    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krrvc"]
Jul 29 01:09:55.715170 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.715143    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:55.715312 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:55.715285    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:55.715805 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.715774    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rdb8t"]
Jul 29 01:09:55.715936 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:55.715915    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:55.716071 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:55.716050    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:56.700278 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:56.700233    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ff7510b-be57-4da4-aba2-442d0b4bff26" containerID="f41cd77be6f4cbdc2d2b1749e52f1d6fc2d86ec18e5c7caaf62ece066d780780" exitCode=0
Jul 29 01:09:56.700676 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:56.700322    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerDied","Data":"f41cd77be6f4cbdc2d2b1749e52f1d6fc2d86ec18e5c7caaf62ece066d780780"}
Jul 29 01:09:57.517131 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:57.517094    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:57.517350 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:57.517195    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:57.517350 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:57.517238    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:57.517350 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:57.517235    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:57.517481 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:57.517342    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:57.517529 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:57.517462    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:09:58.708857 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:58.708810    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ff7510b-be57-4da4-aba2-442d0b4bff26" containerID="fe54595b3dfc5865dc31a71e7ba78fddb32e5a30a4c936552d01760dd06453cd" exitCode=0
Jul 29 01:09:58.709739 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:58.708870    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerDied","Data":"fe54595b3dfc5865dc31a71e7ba78fddb32e5a30a4c936552d01760dd06453cd"}
Jul 29 01:09:59.516839 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:59.516801    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:09:59.517044 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:59.516801    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:09:59.517044 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:59.516940    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rp7rc" podUID="0c8345ad-6415-492b-9916-99eb34c04ae8"
Jul 29 01:09:59.517044 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:59.516979    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-krrvc" podUID="3596ac73-04bb-4dc7-9e79-9df01bd9c756"
Jul 29 01:09:59.517044 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:09:59.516806    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:09:59.517297 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:09:59.517077    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:10:01.184468 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.184417    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:10:01.184917 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.184589    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:01.184917 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.184673    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.184647028 +0000 UTC m=+66.176612685 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:01.285941 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.285836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:10:01.286120 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.286042    2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:01.286191 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.286134    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret podName:0c8345ad-6415-492b-9916-99eb34c04ae8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.286107538 +0000 UTC m=+66.278073191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret") pod "global-pull-secret-syncer-rp7rc" (UID: "0c8345ad-6415-492b-9916-99eb34c04ae8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:01.347350 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.347313    2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeReady"
Jul 29 01:10:01.347518 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.347494    2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:10:01.386431 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.386387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:10:01.386643 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.386579    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:01.386643 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.386616    2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:01.386643 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.386634    2557 projected.go:196] Error preparing data for projected volume kube-api-access-plxl7 for pod openshift-network-diagnostics/network-check-target-krrvc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:01.386784 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.386708    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7 podName:3596ac73-04bb-4dc7-9e79-9df01bd9c756 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.386683803 +0000 UTC m=+66.378649483 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-plxl7" (UniqueName: "kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7") pod "network-check-target-krrvc" (UID: "3596ac73-04bb-4dc7-9e79-9df01bd9c756") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:01.411491 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.411454    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bbjfc"]
Jul 29 01:10:01.414430 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.414400    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.418722 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.418696    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:10:01.418874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.418743    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zd58l\""
Jul 29 01:10:01.418937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.418873    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:10:01.418937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.418903    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wk42l"]
Jul 29 01:10:01.421855 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.421830    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.424407 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.424384    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:10:01.424539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.424425    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:10:01.424539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.424432    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fcjh7\""
Jul 29 01:10:01.424654 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.424557    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:10:01.428038 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.428013    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbjfc"]
Jul 29 01:10:01.438406 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.438379    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wk42l"]
Jul 29 01:10:01.516570 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.516536    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:10:01.516775 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.516545    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:10:01.516775 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.516684    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:10:01.519674 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.519650    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:10:01.519823 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.519698    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:10:01.519823 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.519788    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:10:01.519926 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.519890    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2784\""
Jul 29 01:10:01.520156 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.519955    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jbq7\""
Jul 29 01:10:01.520156 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.519981    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:10:01.589003 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.588789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwjv8\" (UniqueName: \"kubernetes.io/projected/1acebcd2-7200-4d28-9564-f7e74ca99209-kube-api-access-bwjv8\") pod \"ingress-canary-wk42l\" (UID: \"1acebcd2-7200-4d28-9564-f7e74ca99209\") " pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.589207 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.589020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e31af256-f48b-47ee-bea0-753e00ee44d0-tmp-dir\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.589207 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.589105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e31af256-f48b-47ee-bea0-753e00ee44d0-config-volume\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.589207 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.589135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltm9q\" (UniqueName: \"kubernetes.io/projected/e31af256-f48b-47ee-bea0-753e00ee44d0-kube-api-access-ltm9q\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.589207 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.589158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1acebcd2-7200-4d28-9564-f7e74ca99209-cert\") pod \"ingress-canary-wk42l\" (UID: \"1acebcd2-7200-4d28-9564-f7e74ca99209\") " pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.589451 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.589228    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.689869 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.689829    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwjv8\" (UniqueName: \"kubernetes.io/projected/1acebcd2-7200-4d28-9564-f7e74ca99209-kube-api-access-bwjv8\") pod \"ingress-canary-wk42l\" (UID: \"1acebcd2-7200-4d28-9564-f7e74ca99209\") " pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.689869 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.689886    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e31af256-f48b-47ee-bea0-753e00ee44d0-tmp-dir\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.690122 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.689956    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e31af256-f48b-47ee-bea0-753e00ee44d0-config-volume\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.690122 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.689974    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltm9q\" (UniqueName: \"kubernetes.io/projected/e31af256-f48b-47ee-bea0-753e00ee44d0-kube-api-access-ltm9q\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.690122 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.689998    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1acebcd2-7200-4d28-9564-f7e74ca99209-cert\") pod \"ingress-canary-wk42l\" (UID: \"1acebcd2-7200-4d28-9564-f7e74ca99209\") " pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.690122 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.690043    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.690355 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.690176    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:01.690355 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:01.690245    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:02.190225092 +0000 UTC m=+35.182190758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:01.690355 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.690348    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e31af256-f48b-47ee-bea0-753e00ee44d0-tmp-dir\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.690996 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.690969    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e31af256-f48b-47ee-bea0-753e00ee44d0-config-volume\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.695762 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.695732    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1acebcd2-7200-4d28-9564-f7e74ca99209-cert\") pod \"ingress-canary-wk42l\" (UID: \"1acebcd2-7200-4d28-9564-f7e74ca99209\") " pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.702155 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.700623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwjv8\" (UniqueName: \"kubernetes.io/projected/1acebcd2-7200-4d28-9564-f7e74ca99209-kube-api-access-bwjv8\") pod \"ingress-canary-wk42l\" (UID: \"1acebcd2-7200-4d28-9564-f7e74ca99209\") " pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:01.703175 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.703144    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltm9q\" (UniqueName: \"kubernetes.io/projected/e31af256-f48b-47ee-bea0-753e00ee44d0-kube-api-access-ltm9q\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:01.735166 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:01.735118    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wk42l"
Jul 29 01:10:02.194099 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:02.194059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:02.194586 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:02.194297    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:02.194586 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:02.194394    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:03.194367866 +0000 UTC m=+36.186333519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:02.787526 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:02.787488    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wk42l"]
Jul 29 01:10:02.792195 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:10:02.792152    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acebcd2_7200_4d28_9564_f7e74ca99209.slice/crio-82b1ba3d6dbc3fb4d02d5a999baae791034276063d900d39c0e4adb0ab60b82a WatchSource:0}: Error finding container 82b1ba3d6dbc3fb4d02d5a999baae791034276063d900d39c0e4adb0ab60b82a: Status 404 returned error can't find the container with id 82b1ba3d6dbc3fb4d02d5a999baae791034276063d900d39c0e4adb0ab60b82a
Jul 29 01:10:03.201152 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:03.201052    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:03.201563 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:03.201214    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:03.201563 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:03.201313    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:05.201290518 +0000 UTC m=+38.193256164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:03.727046 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:03.727009    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ff7510b-be57-4da4-aba2-442d0b4bff26" containerID="3cf577fd3693b0ec126793601c461afd291e01c2e853aabe413f64a7cf881173" exitCode=0
Jul 29 01:10:03.727239 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:03.727094    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerDied","Data":"3cf577fd3693b0ec126793601c461afd291e01c2e853aabe413f64a7cf881173"}
Jul 29 01:10:03.728643 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:03.728510    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wk42l" event={"ID":"1acebcd2-7200-4d28-9564-f7e74ca99209","Type":"ContainerStarted","Data":"82b1ba3d6dbc3fb4d02d5a999baae791034276063d900d39c0e4adb0ab60b82a"}
Jul 29 01:10:04.735616 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:04.735365    2557 generic.go:356] "Generic (PLEG): container finished" podID="1ff7510b-be57-4da4-aba2-442d0b4bff26" containerID="0688b02ec9f169f2031029b8da20a15548f467fb27b34884ae99ed3e091ed11a" exitCode=0
Jul 29 01:10:04.735616 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:04.735413    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerDied","Data":"0688b02ec9f169f2031029b8da20a15548f467fb27b34884ae99ed3e091ed11a"}
Jul 29 01:10:05.218723 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:05.218684    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:05.218915 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:05.218859    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:05.218993 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:05.218949    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:09.218926496 +0000 UTC m=+42.210892402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:05.742390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:05.742343    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" event={"ID":"1ff7510b-be57-4da4-aba2-442d0b4bff26","Type":"ContainerStarted","Data":"5820e4dd63061e26f9a71b06012b4fa04c5738eaf1ba19a9cfb40d82d999aded"}
Jul 29 01:10:05.744365 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:05.744330    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wk42l" event={"ID":"1acebcd2-7200-4d28-9564-f7e74ca99209","Type":"ContainerStarted","Data":"b0069ac499cc2e9c6a2ae5a21642a3741eec39f47e8bf066d0d85d969416d8c3"}
Jul 29 01:10:05.767691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:05.767527    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6dqtv" podStartSLOduration=10.457332625 podStartE2EDuration="38.767509885s" totalImagesPullingTime="28.31017726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:05.766187802 +0000 UTC m=+38.758153470" watchObservedRunningTime="2026-07-29 01:10:05.767509885 +0000 UTC m=+38.759475553"
Jul 29 01:10:05.781871 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:05.781809    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wk42l" podStartSLOduration=2.062059881 podStartE2EDuration="4.781794615s" totalImagesPullingTime="2.719734734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:05.780908351 +0000 UTC m=+38.772874019" watchObservedRunningTime="2026-07-29 01:10:05.781794615 +0000 UTC m=+38.773760282"
Jul 29 01:10:09.246890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:09.246838    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:09.247367 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:09.247040    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:09.247367 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:09.247136    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:17.247114588 +0000 UTC m=+50.239080237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:17.305083 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:17.305038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:17.305694 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:17.305225    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:17.305694 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:17.305335    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.305311226 +0000 UTC m=+66.297277137 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:27.742338 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:27.742303    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-844xt"
Jul 29 01:10:33.213394 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.213331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:10:33.215947 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.215919    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:10:33.224232 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:33.224194    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:10:33.224401 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:33.224317    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:11:37.224289525 +0000 UTC m=+130.216255170 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : secret "metrics-daemon-secret" not found
Jul 29 01:10:33.314707 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.314654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:10:33.314881 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.314722    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:10:33.314881 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:33.314826    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:10:33.314951 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:10:33.314933    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:05.314915068 +0000 UTC m=+98.306880717 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:10:33.322096 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.322065    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:10:33.328769 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.328735    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c8345ad-6415-492b-9916-99eb34c04ae8-original-pull-secret\") pod \"global-pull-secret-syncer-rp7rc\" (UID: \"0c8345ad-6415-492b-9916-99eb34c04ae8\") " pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:10:33.336074 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.336034    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rp7rc"
Jul 29 01:10:33.415670 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.415613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:10:33.419242 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.419215    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:10:33.429539 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.429497    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:10:33.438968 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.438930    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plxl7\" (UniqueName: \"kubernetes.io/projected/3596ac73-04bb-4dc7-9e79-9df01bd9c756-kube-api-access-plxl7\") pod \"network-check-target-krrvc\" (UID: \"3596ac73-04bb-4dc7-9e79-9df01bd9c756\") " pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:10:33.476372 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.476282    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rp7rc"]
Jul 29 01:10:33.480148 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:10:33.480109    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8345ad_6415_492b_9916_99eb34c04ae8.slice/crio-8dfc700cfe7a3ca54943642eec575c16a325fc60af483ee7ce6047b89107937d WatchSource:0}: Error finding container 8dfc700cfe7a3ca54943642eec575c16a325fc60af483ee7ce6047b89107937d: Status 404 returned error can't find the container with id 8dfc700cfe7a3ca54943642eec575c16a325fc60af483ee7ce6047b89107937d
Jul 29 01:10:33.630056 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.630023    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5jbq7\""
Jul 29 01:10:33.638310 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.638270    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:10:33.782703 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.782575    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-krrvc"]
Jul 29 01:10:33.786308 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:10:33.786246    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3596ac73_04bb_4dc7_9e79_9df01bd9c756.slice/crio-d0c252c77c19b6e09926d5fbb398aa5c7c59eb2079b6265d929a95a9a46c0b90 WatchSource:0}: Error finding container d0c252c77c19b6e09926d5fbb398aa5c7c59eb2079b6265d929a95a9a46c0b90: Status 404 returned error can't find the container with id d0c252c77c19b6e09926d5fbb398aa5c7c59eb2079b6265d929a95a9a46c0b90
Jul 29 01:10:33.815966 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.815917    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krrvc" event={"ID":"3596ac73-04bb-4dc7-9e79-9df01bd9c756","Type":"ContainerStarted","Data":"d0c252c77c19b6e09926d5fbb398aa5c7c59eb2079b6265d929a95a9a46c0b90"}
Jul 29 01:10:33.817193 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:33.817163    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rp7rc" event={"ID":"0c8345ad-6415-492b-9916-99eb34c04ae8","Type":"ContainerStarted","Data":"8dfc700cfe7a3ca54943642eec575c16a325fc60af483ee7ce6047b89107937d"}
Jul 29 01:10:35.380638 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.380597    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"]
Jul 29 01:10:35.398970 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.398901    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"]
Jul 29 01:10:35.399156 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.399022    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.402092 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.402027    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 01:10:35.403813 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.403368    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 01:10:35.403813 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.403368    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 01:10:35.403813 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.403368    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 01:10:35.431556 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.431500    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3b181be-4022-42b6-84c5-62dc252ced5b-tmp\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.431766 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.431604    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a3b181be-4022-42b6-84c5-62dc252ced5b-klusterlet-config\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.431766 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.431639    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnmwt\" (UniqueName: \"kubernetes.io/projected/a3b181be-4022-42b6-84c5-62dc252ced5b-kube-api-access-hnmwt\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.532982 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.532926    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnmwt\" (UniqueName: \"kubernetes.io/projected/a3b181be-4022-42b6-84c5-62dc252ced5b-kube-api-access-hnmwt\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.533196 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.533015    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3b181be-4022-42b6-84c5-62dc252ced5b-tmp\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.533196 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.533087    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a3b181be-4022-42b6-84c5-62dc252ced5b-klusterlet-config\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.544311 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.544245    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3b181be-4022-42b6-84c5-62dc252ced5b-tmp\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.544796 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.544764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a3b181be-4022-42b6-84c5-62dc252ced5b-klusterlet-config\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.547325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.547252    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnmwt\" (UniqueName: \"kubernetes.io/projected/a3b181be-4022-42b6-84c5-62dc252ced5b-kube-api-access-hnmwt\") pod \"klusterlet-addon-workmgr-755d68d5bf-84bp4\" (UID: \"a3b181be-4022-42b6-84c5-62dc252ced5b\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.714908 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.714814    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:35.894245 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:35.894203    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"]
Jul 29 01:10:36.922595 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:10:36.922555    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b181be_4022_42b6_84c5_62dc252ced5b.slice/crio-4e03007412d36b89fceb17cd4ad5aea0c3bba133fdbe94915937a7eb7a8c2844 WatchSource:0}: Error finding container 4e03007412d36b89fceb17cd4ad5aea0c3bba133fdbe94915937a7eb7a8c2844: Status 404 returned error can't find the container with id 4e03007412d36b89fceb17cd4ad5aea0c3bba133fdbe94915937a7eb7a8c2844
Jul 29 01:10:37.831235 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:37.831185    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4" event={"ID":"a3b181be-4022-42b6-84c5-62dc252ced5b","Type":"ContainerStarted","Data":"4e03007412d36b89fceb17cd4ad5aea0c3bba133fdbe94915937a7eb7a8c2844"}
Jul 29 01:10:38.837536 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:38.837438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-krrvc" event={"ID":"3596ac73-04bb-4dc7-9e79-9df01bd9c756","Type":"ContainerStarted","Data":"0d5fa85ae261c8c2a60b57123d0e7bcf3e14b48f8fe4e5191e3e51d95692837e"}
Jul 29 01:10:38.838127 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:38.837608    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:10:38.840245 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:38.840202    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rp7rc" event={"ID":"0c8345ad-6415-492b-9916-99eb34c04ae8","Type":"ContainerStarted","Data":"36377e82ef0610ef39fe02a289ec6a268c66547cb13c46c2287a1e4f80a67ddd"}
Jul 29 01:10:38.856914 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:38.856841    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-krrvc" podStartSLOduration=67.235555126 podStartE2EDuration="1m11.856817726s" totalImagesPullingTime="4.6212626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:38.855093886 +0000 UTC m=+71.847059556" watchObservedRunningTime="2026-07-29 01:10:38.856817726 +0000 UTC m=+71.848783391"
Jul 29 01:10:38.885955 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:38.885896    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rp7rc" podStartSLOduration=66.954160654 podStartE2EDuration="1m11.885878188s" totalImagesPullingTime="4.931717534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:38.885523507 +0000 UTC m=+71.877489176" watchObservedRunningTime="2026-07-29 01:10:38.885878188 +0000 UTC m=+71.877843857"
Jul 29 01:10:42.854113 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:42.854073    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4" event={"ID":"a3b181be-4022-42b6-84c5-62dc252ced5b","Type":"ContainerStarted","Data":"3eec89aa5ad4a9743f6112fd498e2b8595408545611ff54631d771aaf3b72b5e"}
Jul 29 01:10:42.854609 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:42.854379    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:42.856055 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:42.856029    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:10:42.871996 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:10:42.871936    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4" podStartSLOduration=2.954843687 podStartE2EDuration="7.871917957s" totalImagesPullingTime="4.91707427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:42.87123469 +0000 UTC m=+75.863200359" watchObservedRunningTime="2026-07-29 01:10:42.871917957 +0000 UTC m=+75.863883626"
Jul 29 01:11:05.351117 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:11:05.351065    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:11:05.351586 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:11:05.351231    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:05.351586 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:11:05.351346    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:09.35132402 +0000 UTC m=+162.343289666 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:09.847055 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:11:09.847017    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-krrvc"
Jul 29 01:11:37.287351 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:11:37.287307    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:11:37.287870 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:11:37.287471    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:11:37.287870 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:11:37.287554    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:39.287535046 +0000 UTC m=+252.279500700 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : secret "metrics-daemon-secret" not found
Jul 29 01:12:04.427450 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:12:04.427394    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bbjfc" podUID="e31af256-f48b-47ee-bea0-753e00ee44d0"
Jul 29 01:12:04.542280 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:12:04.542221    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:12:05.072416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:05.072380    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:12:09.403187 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:09.403128    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:12:09.403787 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:12:09.403336    2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:12:09.403787 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:12:09.403453    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls podName:e31af256-f48b-47ee-bea0-753e00ee44d0 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:11.403428844 +0000 UTC m=+284.395394507 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls") pod "dns-default-bbjfc" (UID: "e31af256-f48b-47ee-bea0-753e00ee44d0") : secret "dns-default-metrics-tls" not found
Jul 29 01:12:18.516670 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:18.516627    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:12:42.170830 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:42.170793    2557 generic.go:356] "Generic (PLEG): container finished" podID="a3b181be-4022-42b6-84c5-62dc252ced5b" containerID="3eec89aa5ad4a9743f6112fd498e2b8595408545611ff54631d771aaf3b72b5e" exitCode=1
Jul 29 01:12:42.171309 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:42.170873    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4" event={"ID":"a3b181be-4022-42b6-84c5-62dc252ced5b","Type":"ContainerDied","Data":"3eec89aa5ad4a9743f6112fd498e2b8595408545611ff54631d771aaf3b72b5e"}
Jul 29 01:12:42.171309 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:42.171194    2557 scope.go:117] "RemoveContainer" containerID="3eec89aa5ad4a9743f6112fd498e2b8595408545611ff54631d771aaf3b72b5e"
Jul 29 01:12:42.854722 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:42.854668    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:12:43.175468 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:43.175378    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4" event={"ID":"a3b181be-4022-42b6-84c5-62dc252ced5b","Type":"ContainerStarted","Data":"f11aa587c2ff9e94194278bd8e7ecd64749912ff821d273fc928e3d55719d984"}
Jul 29 01:12:43.175866 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:43.175602    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:12:43.176235 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:12:43.176219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-755d68d5bf-84bp4"
Jul 29 01:13:22.541041 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.540996    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"]
Jul 29 01:13:22.543340 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.543308    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.546357 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.546323    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 01:13:22.546696 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.546669    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.546696 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.546694    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 01:13:22.546894 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.546719    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.547761 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.547739    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lnmcr\""
Jul 29 01:13:22.551758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.551728    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-57d9b86687-ssxmq"]
Jul 29 01:13:22.554130 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.554099    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6785847fcd-lzwtj"]
Jul 29 01:13:22.554288 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.554222    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.556478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.556446    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.557076 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.557050    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 01:13:22.557210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.557050    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 01:13:22.557210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.557111    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 01:13:22.557338 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.557233    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 01:13:22.557550 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.557530    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.557719 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.557704    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.558583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.558562    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vj9hf\""
Jul 29 01:13:22.559695 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.559668    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 01:13:22.560324 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.560299    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 01:13:22.560472 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.560303    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lfkw5\""
Jul 29 01:13:22.564349 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.564317    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 01:13:22.565005 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.564977    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"]
Jul 29 01:13:22.574980 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.574930    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57d9b86687-ssxmq"]
Jul 29 01:13:22.575455 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.575425    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 01:13:22.575782 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.575751    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6785847fcd-lzwtj"]
Jul 29 01:13:22.646405 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.646361    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"]
Jul 29 01:13:22.648677 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.648648    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.653706 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.653664    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:13:22.653706 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.653696    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 01:13:22.653937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.653664    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-597hw\""
Jul 29 01:13:22.653937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.653669    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 01:13:22.654398 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.654381    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:13:22.668861 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.668822    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"]
Jul 29 01:13:22.721704 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721667    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.721704 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-installation-pull-secrets\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.721962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721729    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rntzl\" (UniqueName: \"kubernetes.io/projected/4ad08486-9b66-4bea-ab14-3498da5c3a4d-kube-api-access-rntzl\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.721962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721792    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-trusted-ca\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.721962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721832    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9mm6\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-kube-api-access-h9mm6\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.721962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721870    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrdtw\" (UniqueName: \"kubernetes.io/projected/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-kube-api-access-jrdtw\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.721962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721895    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21b73ce2-c107-49d1-9c83-b3964c406147-ca-trust-extracted\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.721962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721927    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.721972    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722035    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-registry-certificates\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722053    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-stats-auth\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722091    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-bound-sa-token\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722113    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-config\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722129    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-image-registry-private-configuration\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722146    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-default-certificate\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.722182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.722167    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.823281 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823154    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.823281 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823207    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-stats-auth\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.823281 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823238    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqdn\" (UniqueName: \"kubernetes.io/projected/20ff1210-95e5-4333-b5f1-a108f792e91a-kube-api-access-pcqdn\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.823558 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823305    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-bound-sa-token\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.823558 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823340    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-config\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.823558 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.823356    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:13:22.823558 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823389    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-image-registry-private-configuration\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.823558 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.823511    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:23.323485307 +0000 UTC m=+236.315450952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : secret "router-metrics-certs-default" not found
Jul 29 01:13:22.823558 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823542    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-default-certificate\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823575    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20ff1210-95e5-4333-b5f1-a108f792e91a-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823611    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823645    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-installation-pull-secrets\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823677    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-trusted-ca\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823700    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9mm6\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-kube-api-access-h9mm6\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823725    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rntzl\" (UniqueName: \"kubernetes.io/projected/4ad08486-9b66-4bea-ab14-3498da5c3a4d-kube-api-access-rntzl\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823776    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823813    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-registry-certificates\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.823847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823845    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrdtw\" (UniqueName: \"kubernetes.io/projected/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-kube-api-access-jrdtw\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823868    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21b73ce2-c107-49d1-9c83-b3964c406147-ca-trust-extracted\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.823930    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:23.323911421 +0000 UTC m=+236.315877081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : configmap references non-existent config key: service-ca.crt
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.823967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.824007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.824032    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-config\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.824142    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.824156    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6785847fcd-lzwtj: secret "image-registry-tls" not found
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.824194    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21b73ce2-c107-49d1-9c83-b3964c406147-ca-trust-extracted\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.824278 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.824207    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls podName:21b73ce2-c107-49d1-9c83-b3964c406147 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:23.324191485 +0000 UTC m=+236.316157130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls") pod "image-registry-6785847fcd-lzwtj" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147") : secret "image-registry-tls" not found
Jul 29 01:13:22.824843 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.824812    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-trusted-ca\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.825006 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.824850    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-registry-certificates\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.826186 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.826156    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-stats-auth\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.826395 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.826371    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-default-certificate\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.826467 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.826437    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-installation-pull-secrets\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.826772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.826755    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-serving-cert\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.826831 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.826795    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-image-registry-private-configuration\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.832993 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.832906    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-bound-sa-token\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.833234 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.833079    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrdtw\" (UniqueName: \"kubernetes.io/projected/95fbc2fa-5f95-40b9-85ac-8add3aee4faf-kube-api-access-jrdtw\") pod \"service-ca-operator-5d6c75f84f-rjs49\" (UID: \"95fbc2fa-5f95-40b9-85ac-8add3aee4faf\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.833434 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.833393    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9mm6\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-kube-api-access-h9mm6\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:22.833960 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.833932    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rntzl\" (UniqueName: \"kubernetes.io/projected/4ad08486-9b66-4bea-ab14-3498da5c3a4d-kube-api-access-rntzl\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:22.854330 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.854294    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"
Jul 29 01:13:22.925386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.925311    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqdn\" (UniqueName: \"kubernetes.io/projected/20ff1210-95e5-4333-b5f1-a108f792e91a-kube-api-access-pcqdn\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.925386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.925374    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20ff1210-95e5-4333-b5f1-a108f792e91a-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.925386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.925406    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.925729 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.925563    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:22.925729 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:22.925633    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls podName:20ff1210-95e5-4333-b5f1-a108f792e91a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:23.425610069 +0000 UTC m=+236.417575723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m9shv" (UID: "20ff1210-95e5-4333-b5f1-a108f792e91a") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:22.926590 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.926556    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/20ff1210-95e5-4333-b5f1-a108f792e91a-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.935091 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.935050    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqdn\" (UniqueName: \"kubernetes.io/projected/20ff1210-95e5-4333-b5f1-a108f792e91a-kube-api-access-pcqdn\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:22.993903 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:22.993859    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49"]
Jul 29 01:13:22.997671 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:13:22.997639    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95fbc2fa_5f95_40b9_85ac_8add3aee4faf.slice/crio-52fb64a2ae521a3cdeae9dc20f212f244ec0a4583987b8eb91ea346360e01012 WatchSource:0}: Error finding container 52fb64a2ae521a3cdeae9dc20f212f244ec0a4583987b8eb91ea346360e01012: Status 404 returned error can't find the container with id 52fb64a2ae521a3cdeae9dc20f212f244ec0a4583987b8eb91ea346360e01012
Jul 29 01:13:23.280821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:23.280775    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49" event={"ID":"95fbc2fa-5f95-40b9-85ac-8add3aee4faf","Type":"ContainerStarted","Data":"52fb64a2ae521a3cdeae9dc20f212f244ec0a4583987b8eb91ea346360e01012"}
Jul 29 01:13:23.329285 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:23.329229    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:23.329498 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:23.329322    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:23.329498 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:23.329344    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:23.329498 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.329412    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:24.329393381 +0000 UTC m=+237.321359029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : configmap references non-existent config key: service-ca.crt
Jul 29 01:13:23.329498 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.329466    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:13:23.329498 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.329476    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:23.329498 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.329497    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6785847fcd-lzwtj: secret "image-registry-tls" not found
Jul 29 01:13:23.329725 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.329519    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:24.329506625 +0000 UTC m=+237.321472271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : secret "router-metrics-certs-default" not found
Jul 29 01:13:23.329725 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.329544    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls podName:21b73ce2-c107-49d1-9c83-b3964c406147 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:24.32952881 +0000 UTC m=+237.321494459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls") pod "image-registry-6785847fcd-lzwtj" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147") : secret "image-registry-tls" not found
Jul 29 01:13:23.430506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:23.430461    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:23.430707 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.430631    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:23.430769 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:23.430713    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls podName:20ff1210-95e5-4333-b5f1-a108f792e91a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:24.430693329 +0000 UTC m=+237.422658975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m9shv" (UID: "20ff1210-95e5-4333-b5f1-a108f792e91a") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:24.338778 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:24.338729    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:24.338820    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:24.338842    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.338935    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:26.338910042 +0000 UTC m=+239.330875700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : configmap references non-existent config key: service-ca.crt
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.338996    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.339004    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.339023    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6785847fcd-lzwtj: secret "image-registry-tls" not found
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.339055    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:26.339039854 +0000 UTC m=+239.331005505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : secret "router-metrics-certs-default" not found
Jul 29 01:13:24.339341 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.339074    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls podName:21b73ce2-c107-49d1-9c83-b3964c406147 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:26.339065206 +0000 UTC m=+239.331030851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls") pod "image-registry-6785847fcd-lzwtj" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147") : secret "image-registry-tls" not found
Jul 29 01:13:24.440313 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:24.440244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:24.440505 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.440428    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:24.440562 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:24.440505    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls podName:20ff1210-95e5-4333-b5f1-a108f792e91a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:26.440488204 +0000 UTC m=+239.432453849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m9shv" (UID: "20ff1210-95e5-4333-b5f1-a108f792e91a") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:25.288818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:25.288777    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49" event={"ID":"95fbc2fa-5f95-40b9-85ac-8add3aee4faf","Type":"ContainerStarted","Data":"df407d2c170bc946725c5e1e79331796c3a7afc7b7a5479429feb5c48da4fb91"}
Jul 29 01:13:25.305156 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:25.305091    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49" podStartSLOduration=1.644096168 podStartE2EDuration="3.305073967s" totalImagesPullingTime="1.660977799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:25.304348793 +0000 UTC m=+238.296314459" watchObservedRunningTime="2026-07-29 01:13:25.305073967 +0000 UTC m=+238.297039695"
Jul 29 01:13:26.355604 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:26.355539    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:26.355604 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:26.355620    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:26.355640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.355727    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.355706321 +0000 UTC m=+243.347671971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : configmap references non-existent config key: service-ca.crt
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.355762    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.355789    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.355802    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.355791194 +0000 UTC m=+243.347756839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : secret "router-metrics-certs-default" not found
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.355809    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6785847fcd-lzwtj: secret "image-registry-tls" not found
Jul 29 01:13:26.356110 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.355857    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls podName:21b73ce2-c107-49d1-9c83-b3964c406147 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.355840679 +0000 UTC m=+243.347806347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls") pod "image-registry-6785847fcd-lzwtj" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147") : secret "image-registry-tls" not found
Jul 29 01:13:26.456614 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:26.456575    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:26.456857 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.456783    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:26.456945 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:26.456875    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls podName:20ff1210-95e5-4333-b5f1-a108f792e91a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:30.456853865 +0000 UTC m=+243.448819515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m9shv" (UID: "20ff1210-95e5-4333-b5f1-a108f792e91a") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:27.205438 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.205398    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w8cdm"]
Jul 29 01:13:27.207950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.207919    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.210554 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.210516    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:13:27.210730 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.210657    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:13:27.210878 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.210858    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:13:27.210993 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.210904    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:13:27.212541 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.212517    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbnhx\""
Jul 29 01:13:27.218465 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.218429    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8cdm"]
Jul 29 01:13:27.364922 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.364871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-crio-socket\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.364922 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.364917    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-data-volume\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.365430 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.364958    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjnlv\" (UniqueName: \"kubernetes.io/projected/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-api-access-zjnlv\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.365430 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.364989    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.365430 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.365020    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.465723 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.465612    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-crio-socket\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.465723 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.465661    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-data-volume\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.465723 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.465710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjnlv\" (UniqueName: \"kubernetes.io/projected/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-api-access-zjnlv\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.465975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.465738    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-crio-socket\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.465975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.465756    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.465975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.465798    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.466137 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.466111    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-data-volume\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:27.468671 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.468646    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:13:27.468798 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.468669    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:13:27.474184 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.474152    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:13:27.476103 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:27.476077    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.476194 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:27.476149    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.976132074 +0000 UTC m=+240.968097720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:27.476244 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:27.476225    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.476317 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:27.476291    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:27.976277402 +0000 UTC m=+240.968243048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:27.484816 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.484780    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:13:27.495486 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:27.495446    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjnlv\" (UniqueName: \"kubernetes.io/projected/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-api-access-zjnlv\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:28.070229 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:28.070178    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:28.070462 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:28.070360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:28.070462 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:28.070360    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.070462 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:28.070448    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:29.070431195 +0000 UTC m=+242.062396843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:28.070603 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:28.070479    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:28.070603 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:28.070561    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:29.070544017 +0000 UTC m=+242.062509662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:29.079211 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:29.079149    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:29.079706 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:29.079341    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:29.079706 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:29.079369    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:29.079706 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:29.079410    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:29.079706 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:29.079447    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:31.079427484 +0000 UTC m=+244.071393141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:29.079706 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:29.079476    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:31.07946655 +0000 UTC m=+244.071432207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:29.197217 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:29.197187    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2s9f_53ff96e0-5f44-4e0d-9d7d-db58f38cbc35/dns-node-resolver/0.log"
Jul 29 01:13:30.197349 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:30.197315    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cz9m2_b9f15f19-5d1e-4223-b23b-e0a52f56af72/node-ca/0.log"
Jul 29 01:13:30.390665 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:30.390616    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:30.390665 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:30.390673    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:30.390733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.390785    2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.390809    2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6785847fcd-lzwtj: secret "image-registry-tls" not found
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.390845    2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.390859    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls podName:21b73ce2-c107-49d1-9c83-b3964c406147 nodeName:}" failed. No retries permitted until 2026-07-29 01:13:38.390844488 +0000 UTC m=+251.382810134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls") pod "image-registry-6785847fcd-lzwtj" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147") : secret "image-registry-tls" not found
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.390888    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:38.390870137 +0000 UTC m=+251.382835783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : configmap references non-existent config key: service-ca.crt
Jul 29 01:13:30.390902 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.390908    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:38.390900317 +0000 UTC m=+251.382865962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : secret "router-metrics-certs-default" not found
Jul 29 01:13:30.491139 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:30.491050    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:30.491242 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.491203    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:30.491309 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:30.491291    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls podName:20ff1210-95e5-4333-b5f1-a108f792e91a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:38.49127412 +0000 UTC m=+251.483239779 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m9shv" (UID: "20ff1210-95e5-4333-b5f1-a108f792e91a") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:31.096213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:31.096164    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:31.096459 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:31.096232    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:31.096459 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:31.096328    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:31.096459 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:31.096382    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:31.096459 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:31.096401    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:35.096385287 +0000 UTC m=+248.088350932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:31.096459 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:31.096437    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:35.096421621 +0000 UTC m=+248.088387272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:31.195952 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:31.195906    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wk42l_1acebcd2-7200-4d28-9564-f7e74ca99209/serve-healthcheck-canary/0.log"
Jul 29 01:13:35.129316 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:35.129234    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:35.129776 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:35.129341    2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:13:35.129776 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:35.129426    2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:35.129776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:35.129343    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:35.129776 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:35.129432    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.129410926 +0000 UTC m=+256.121376577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : configmap "kube-rbac-proxy" not found
Jul 29 01:13:35.129776 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:35.129543    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls podName:e3c1ad3b-3ffe-4abc-893e-3bb76981eeee nodeName:}" failed. No retries permitted until 2026-07-29 01:13:43.12949933 +0000 UTC m=+256.121464981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w8cdm" (UID: "e3c1ad3b-3ffe-4abc-893e-3bb76981eeee") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:13:38.456603 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.456560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:38.457082 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.456630    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:38.457082 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.456657    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:38.457082 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:38.456741    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle podName:4ad08486-9b66-4bea-ab14-3498da5c3a4d nodeName:}" failed. No retries permitted until 2026-07-29 01:13:54.456722431 +0000 UTC m=+267.448688076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle") pod "router-default-57d9b86687-ssxmq" (UID: "4ad08486-9b66-4bea-ab14-3498da5c3a4d") : configmap references non-existent config key: service-ca.crt
Jul 29 01:13:38.459355 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.459305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ad08486-9b66-4bea-ab14-3498da5c3a4d-metrics-certs\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:38.459488 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.459305    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"image-registry-6785847fcd-lzwtj\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") " pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:38.478005 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.477966    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lfkw5\""
Jul 29 01:13:38.486092 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.486051    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:38.557684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.557645    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:38.557863 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:38.557802    2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:38.557905 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:38.557874    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls podName:20ff1210-95e5-4333-b5f1-a108f792e91a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:54.557857817 +0000 UTC m=+267.549823465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-m9shv" (UID: "20ff1210-95e5-4333-b5f1-a108f792e91a") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:13:38.625541 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:38.625342    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6785847fcd-lzwtj"]
Jul 29 01:13:38.629461 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:13:38.629417    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b73ce2_c107_49d1_9c83_b3964c406147.slice/crio-aff40a466c9bedc3ef714626c27ac49c3e4569ea16a945fd19fc513aaf2e7f80 WatchSource:0}: Error finding container aff40a466c9bedc3ef714626c27ac49c3e4569ea16a945fd19fc513aaf2e7f80: Status 404 returned error can't find the container with id aff40a466c9bedc3ef714626c27ac49c3e4569ea16a945fd19fc513aaf2e7f80
Jul 29 01:13:39.333932 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:39.333887    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" event={"ID":"21b73ce2-c107-49d1-9c83-b3964c406147","Type":"ContainerStarted","Data":"8335e471924582d00b7948386b33d23ec2cc14c1ad284fe4f00453d8be40ab91"}
Jul 29 01:13:39.334116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:39.333943    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" event={"ID":"21b73ce2-c107-49d1-9c83-b3964c406147","Type":"ContainerStarted","Data":"aff40a466c9bedc3ef714626c27ac49c3e4569ea16a945fd19fc513aaf2e7f80"}
Jul 29 01:13:39.334116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:39.333978    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:13:39.354667 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:39.354566    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" podStartSLOduration=17.354545419 podStartE2EDuration="17.354545419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:39.354313671 +0000 UTC m=+252.346279338" watchObservedRunningTime="2026-07-29 01:13:39.354545419 +0000 UTC m=+252.346511086"
Jul 29 01:13:39.365641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:39.365596    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:13:39.365791 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:39.365712    2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:13:39.365791 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:13:39.365781    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs podName:3e6d744d-8d4e-4697-89a2-7b343e495e0d nodeName:}" failed. No retries permitted until 2026-07-29 01:15:41.365762969 +0000 UTC m=+374.357728614 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs") pod "network-metrics-daemon-rdb8t" (UID: "3e6d744d-8d4e-4697-89a2-7b343e495e0d") : secret "metrics-daemon-secret" not found
Jul 29 01:13:43.198117 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.198047    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:43.198117 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.198115    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:43.198650 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.198626    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:43.200579 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.200536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3c1ad3b-3ffe-4abc-893e-3bb76981eeee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w8cdm\" (UID: \"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee\") " pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:43.421582 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.421541    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tbnhx\""
Jul 29 01:13:43.429847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.429813    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w8cdm"
Jul 29 01:13:43.568591 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:43.568548    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w8cdm"]
Jul 29 01:13:43.573005 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:13:43.572958    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c1ad3b_3ffe_4abc_893e_3bb76981eeee.slice/crio-d6afe4698052ec4fed8b30bc40f357ff72202a31a144cc08bd5d2194359a8dd6 WatchSource:0}: Error finding container d6afe4698052ec4fed8b30bc40f357ff72202a31a144cc08bd5d2194359a8dd6: Status 404 returned error can't find the container with id d6afe4698052ec4fed8b30bc40f357ff72202a31a144cc08bd5d2194359a8dd6
Jul 29 01:13:44.352698 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:44.352655    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8cdm" event={"ID":"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee","Type":"ContainerStarted","Data":"d6afe4698052ec4fed8b30bc40f357ff72202a31a144cc08bd5d2194359a8dd6"}
Jul 29 01:13:49.372946 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:49.372847    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8cdm" event={"ID":"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee","Type":"ContainerStarted","Data":"707d088b8560f207238d234d55e3a2e4207c5d81b8738bc949f85f87e41dba7e"}
Jul 29 01:13:52.370536 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.370490    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6785847fcd-lzwtj"]
Jul 29 01:13:52.386940 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.386904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8cdm" event={"ID":"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee","Type":"ContainerStarted","Data":"fcf6ff2aa03d562430ead170bb58b7b7f5cd6fca6231b67e0809b06982bc45f8"}
Jul 29 01:13:52.405990 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.405947    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-547b6b79db-5qxm2"]
Jul 29 01:13:52.408520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.408481    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.426441 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.425283    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-547b6b79db-5qxm2"]
Jul 29 01:13:52.474402 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474353    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-ca-trust-extracted\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474418    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-image-registry-private-configuration\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474490    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-trusted-ca\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474529    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-registry-certificates\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474583 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474558    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-installation-pull-secrets\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474599    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-registry-tls\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474674    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llcp9\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-kube-api-access-llcp9\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.474777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.474708    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-bound-sa-token\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.575946 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.575903    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-registry-tls\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576170 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.575967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llcp9\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-kube-api-access-llcp9\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576170 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576025    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-bound-sa-token\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576170 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576092    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-ca-trust-extracted\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576170 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-image-registry-private-configuration\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576190    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-trusted-ca\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576244    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-registry-certificates\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.576374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576306    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-installation-pull-secrets\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.577825 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.576869    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-ca-trust-extracted\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.577825 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.577719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-registry-certificates\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.577825 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.577764    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-trusted-ca\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.579172 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.579131    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-registry-tls\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.579770 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.579719    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-image-registry-private-configuration\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.579885 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.579867    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-installation-pull-secrets\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.587094 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.587010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-bound-sa-token\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.588212 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.588165    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llcp9\" (UniqueName: \"kubernetes.io/projected/dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10-kube-api-access-llcp9\") pod \"image-registry-547b6b79db-5qxm2\" (UID: \"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10\") " pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.722009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.721912    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:52.876517 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:52.876138    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-547b6b79db-5qxm2"]
Jul 29 01:13:52.879911 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:13:52.879871    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfbb5e8f_11b6_4a8e_b86d_edb4c84b8a10.slice/crio-af94774c57cbcf04d5942f2b9ac78236db0459bcbb0390e3e14ffc04fa4b91c6 WatchSource:0}: Error finding container af94774c57cbcf04d5942f2b9ac78236db0459bcbb0390e3e14ffc04fa4b91c6: Status 404 returned error can't find the container with id af94774c57cbcf04d5942f2b9ac78236db0459bcbb0390e3e14ffc04fa4b91c6
Jul 29 01:13:53.394305 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:53.394243    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2" event={"ID":"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10","Type":"ContainerStarted","Data":"de09ccb4bdce55473a1933a6b7e9d444bd1f43cbe8db4977e45ceff455b28c3c"}
Jul 29 01:13:53.394800 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:53.394345    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2" event={"ID":"dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10","Type":"ContainerStarted","Data":"af94774c57cbcf04d5942f2b9ac78236db0459bcbb0390e3e14ffc04fa4b91c6"}
Jul 29 01:13:53.418683 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:53.418618    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2" podStartSLOduration=1.418589599 podStartE2EDuration="1.418589599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:53.416806462 +0000 UTC m=+266.408772129" watchObservedRunningTime="2026-07-29 01:13:53.418589599 +0000 UTC m=+266.410555245"
Jul 29 01:13:54.399364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.399317    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:13:54.495078 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.494761    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:54.495502 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.495467    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ad08486-9b66-4bea-ab14-3498da5c3a4d-service-ca-bundle\") pod \"router-default-57d9b86687-ssxmq\" (UID: \"4ad08486-9b66-4bea-ab14-3498da5c3a4d\") " pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:54.596482 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.596441    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:54.599459 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.599421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/20ff1210-95e5-4333-b5f1-a108f792e91a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-m9shv\" (UID: \"20ff1210-95e5-4333-b5f1-a108f792e91a\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:54.668390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.668287    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vj9hf\""
Jul 29 01:13:54.676712 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.676673    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:54.761336 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.761308    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-597hw\""
Jul 29 01:13:54.769462 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:54.769417    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"
Jul 29 01:13:55.386613 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:55.386582    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-57d9b86687-ssxmq"]
Jul 29 01:13:55.388775 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:13:55.388742    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad08486_9b66_4bea_ab14_3498da5c3a4d.slice/crio-0ab6028e8f7130159b8197d44b61d1a8f3f97356f02f456c619b8a6324228dad WatchSource:0}: Error finding container 0ab6028e8f7130159b8197d44b61d1a8f3f97356f02f456c619b8a6324228dad: Status 404 returned error can't find the container with id 0ab6028e8f7130159b8197d44b61d1a8f3f97356f02f456c619b8a6324228dad
Jul 29 01:13:55.399900 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:55.399872    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv"]
Jul 29 01:13:55.404319 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:13:55.404296    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ff1210_95e5_4333_b5f1_a108f792e91a.slice/crio-10dea4aca0200f1b07e34a42d019de02b03b646fc5046ae4136bb369bd7e69d8 WatchSource:0}: Error finding container 10dea4aca0200f1b07e34a42d019de02b03b646fc5046ae4136bb369bd7e69d8: Status 404 returned error can't find the container with id 10dea4aca0200f1b07e34a42d019de02b03b646fc5046ae4136bb369bd7e69d8
Jul 29 01:13:55.407818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:55.407784    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w8cdm" event={"ID":"e3c1ad3b-3ffe-4abc-893e-3bb76981eeee","Type":"ContainerStarted","Data":"4c25e77de147c520843e2b52946a4535e802850ccd33ca5b952080f169cdab83"}
Jul 29 01:13:55.409186 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:55.409164    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57d9b86687-ssxmq" event={"ID":"4ad08486-9b66-4bea-ab14-3498da5c3a4d","Type":"ContainerStarted","Data":"0ab6028e8f7130159b8197d44b61d1a8f3f97356f02f456c619b8a6324228dad"}
Jul 29 01:13:55.426546 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:55.426503    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w8cdm" podStartSLOduration=16.831765582 podStartE2EDuration="28.426486817s" totalImagesPullingTime="11.594721235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:13:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:55.425765007 +0000 UTC m=+268.417730674" watchObservedRunningTime="2026-07-29 01:13:55.426486817 +0000 UTC m=+268.418452486"
Jul 29 01:13:56.415095 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:56.415041    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-57d9b86687-ssxmq" event={"ID":"4ad08486-9b66-4bea-ab14-3498da5c3a4d","Type":"ContainerStarted","Data":"e4478e57aab87fe5abd1c8af2c8faee9800a8e46bf4d682c7f5223016b1050ef"}
Jul 29 01:13:56.416431 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:56.416393    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv" event={"ID":"20ff1210-95e5-4333-b5f1-a108f792e91a","Type":"ContainerStarted","Data":"10dea4aca0200f1b07e34a42d019de02b03b646fc5046ae4136bb369bd7e69d8"}
Jul 29 01:13:56.437417 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:56.437349    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-57d9b86687-ssxmq" podStartSLOduration=34.437322103 podStartE2EDuration="34.437322103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:56.436158708 +0000 UTC m=+269.428124387" watchObservedRunningTime="2026-07-29 01:13:56.437322103 +0000 UTC m=+269.429287779"
Jul 29 01:13:56.677976 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:56.677873    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:56.681095 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:56.681064    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:57.422747 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:57.422703    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv" event={"ID":"20ff1210-95e5-4333-b5f1-a108f792e91a","Type":"ContainerStarted","Data":"f32a38383bd573a8baff38c0ae8aaaa2bdc774994f508b141e8198ce61de4bfc"}
Jul 29 01:13:57.423253 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:57.422910    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:57.424353 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:57.424328    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-57d9b86687-ssxmq"
Jul 29 01:13:57.438857 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:13:57.438797    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-m9shv" podStartSLOduration=33.795891112 podStartE2EDuration="35.438753034s" totalImagesPullingTime="1.642861922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:13:57.438446984 +0000 UTC m=+270.430412651" watchObservedRunningTime="2026-07-29 01:13:57.438753034 +0000 UTC m=+270.430718700"
Jul 29 01:14:02.377542 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:02.377493    2557 patch_prober.go:28] interesting pod/image-registry-6785847fcd-lzwtj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:02.378010 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:02.377558    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:05.655989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.655942    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f5db4c5c6-pmh2r"]
Jul 29 01:14:05.659514 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.659477    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.662081 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.662047    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 01:14:05.662211 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.662077    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 01:14:05.662211 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.662108    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 01:14:05.663163 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.663141    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9xgr5\""
Jul 29 01:14:05.663227 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.663147    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 01:14:05.663227 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.663180    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 01:14:05.663563 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.663545    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 01:14:05.663631 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.663582    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 01:14:05.667708 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.667685    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 01:14:05.670279 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.670237    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5db4c5c6-pmh2r"]
Jul 29 01:14:05.793755 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.793687    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-oauth-config\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.793755 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.793762    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-trusted-ca-bundle\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.793989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.793833    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-oauth-serving-cert\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.793989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.793920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-serving-cert\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.793989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.793950    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-service-ca\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.793989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.793986    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvc7r\" (UniqueName: \"kubernetes.io/projected/67f7703b-fbc9-4463-af25-1937d6c73b14-kube-api-access-jvc7r\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.794150 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.794060    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-console-config\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895396 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvc7r\" (UniqueName: \"kubernetes.io/projected/67f7703b-fbc9-4463-af25-1937d6c73b14-kube-api-access-jvc7r\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895528 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895404    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-console-config\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895535    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-oauth-config\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895580    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-trusted-ca-bundle\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895599    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-oauth-serving-cert\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895735 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895629    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-serving-cert\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.895735 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.895660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-service-ca\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.896179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.896151    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-console-config\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.896342 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.896320    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-oauth-serving-cert\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.896397 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.896382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-service-ca\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.896493 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.896473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-trusted-ca-bundle\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.897886 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.897861    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-oauth-config\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.898312 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.898291    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-serving-cert\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.904242 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.904213    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvc7r\" (UniqueName: \"kubernetes.io/projected/67f7703b-fbc9-4463-af25-1937d6c73b14-kube-api-access-jvc7r\") pod \"console-f5db4c5c6-pmh2r\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") " pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:05.971077 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:05.970983    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:06.106077 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:06.106037    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f5db4c5c6-pmh2r"]
Jul 29 01:14:06.109850 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:06.109804    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f7703b_fbc9_4463_af25_1937d6c73b14.slice/crio-7dc8dcb2fac6aa57ef5d9d4186b4e783a0edb9d14ff828bcdd29b34a90946321 WatchSource:0}: Error finding container 7dc8dcb2fac6aa57ef5d9d4186b4e783a0edb9d14ff828bcdd29b34a90946321: Status 404 returned error can't find the container with id 7dc8dcb2fac6aa57ef5d9d4186b4e783a0edb9d14ff828bcdd29b34a90946321
Jul 29 01:14:06.454062 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:06.454024    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5db4c5c6-pmh2r" event={"ID":"67f7703b-fbc9-4463-af25-1937d6c73b14","Type":"ContainerStarted","Data":"7dc8dcb2fac6aa57ef5d9d4186b4e783a0edb9d14ff828bcdd29b34a90946321"}
Jul 29 01:14:08.073154 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:14:08.073099    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bbjfc" podUID="e31af256-f48b-47ee-bea0-753e00ee44d0"
Jul 29 01:14:08.461383 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:08.461340    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:14:09.466171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:09.466136    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5db4c5c6-pmh2r" event={"ID":"67f7703b-fbc9-4463-af25-1937d6c73b14","Type":"ContainerStarted","Data":"62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47"}
Jul 29 01:14:09.485900 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:09.485842    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f5db4c5c6-pmh2r" podStartSLOduration=1.825677009 podStartE2EDuration="4.485825351s" totalImagesPullingTime="2.660148342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:09.48468633 +0000 UTC m=+282.476652032" watchObservedRunningTime="2026-07-29 01:14:09.485825351 +0000 UTC m=+282.477791018"
Jul 29 01:14:11.442446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:11.442388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:14:11.445060 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:11.445028    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e31af256-f48b-47ee-bea0-753e00ee44d0-metrics-tls\") pod \"dns-default-bbjfc\" (UID: \"e31af256-f48b-47ee-bea0-753e00ee44d0\") " pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:14:11.465089 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:11.465048    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zd58l\""
Jul 29 01:14:11.472470 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:11.472429    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:14:11.630296 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:11.630235    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbjfc"]
Jul 29 01:14:11.634914 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:11.634879    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31af256_f48b_47ee_bea0_753e00ee44d0.slice/crio-c5824d9d979f86ec301bfed8096e3fd9f880636eee77493aad27ef98f552f94b WatchSource:0}: Error finding container c5824d9d979f86ec301bfed8096e3fd9f880636eee77493aad27ef98f552f94b: Status 404 returned error can't find the container with id c5824d9d979f86ec301bfed8096e3fd9f880636eee77493aad27ef98f552f94b
Jul 29 01:14:12.376420 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:12.376379    2557 patch_prober.go:28] interesting pod/image-registry-6785847fcd-lzwtj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:12.376612 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:12.376450    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:12.482546 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:12.482494    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbjfc" event={"ID":"e31af256-f48b-47ee-bea0-753e00ee44d0","Type":"ContainerStarted","Data":"c5824d9d979f86ec301bfed8096e3fd9f880636eee77493aad27ef98f552f94b"}
Jul 29 01:14:12.728683 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:12.728562    2557 patch_prober.go:28] interesting pod/image-registry-547b6b79db-5qxm2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:12.728683 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:12.728639    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2" podUID="dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:13.488491 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:13.488454    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbjfc" event={"ID":"e31af256-f48b-47ee-bea0-753e00ee44d0","Type":"ContainerStarted","Data":"04a5c6b41de69334d50bc80b891bf4dd420cbcaacb666f57cda4604873a27064"}
Jul 29 01:14:13.488896 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:13.488513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbjfc" event={"ID":"e31af256-f48b-47ee-bea0-753e00ee44d0","Type":"ContainerStarted","Data":"ff06b9fe777750658ba72becde16362f07364f9a19efdc58f3bb78acc51d3db9"}
Jul 29 01:14:13.488896 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:13.488617    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:14:13.506894 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:13.506833    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bbjfc" podStartSLOduration=250.880702966 podStartE2EDuration="4m12.506811945s" totalImagesPullingTime="1.626108979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:13.50645352 +0000 UTC m=+286.498419187" watchObservedRunningTime="2026-07-29 01:14:13.506811945 +0000 UTC m=+286.498777614"
Jul 29 01:14:14.962534 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.962486    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"]
Jul 29 01:14:14.965934 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.965903    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:14.969126 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.969094    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9whcm\""
Jul 29 01:14:14.970284 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.970231    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:14:14.970284 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.970244    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 29 01:14:14.970284 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.970278    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 29 01:14:14.974012 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.973984    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0119068f-a141-446d-8b07-462fbdd773ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:14.974127 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.974041    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0119068f-a141-446d-8b07-462fbdd773ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:14.974179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.974115    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0119068f-a141-446d-8b07-462fbdd773ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:14.974179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.974150    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxqsd\" (UniqueName: \"kubernetes.io/projected/0119068f-a141-446d-8b07-462fbdd773ab-kube-api-access-vxqsd\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:14.979641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.979595    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"]
Jul 29 01:14:14.995245 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.995192    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j28w8"]
Jul 29 01:14:14.998368 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:14.998333    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.001274 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.001230    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:14:15.001794 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.001763    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:14:15.001974 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.001953    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:14:15.002028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.001992    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-56rrk\""
Jul 29 01:14:15.074848 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.074808    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-root\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.074861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-sys\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.074885    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0119068f-a141-446d-8b07-462fbdd773ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.075009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.074926    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-accelerators-collector-config\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.074951    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-textfile\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.074971    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rvfq\" (UniqueName: \"kubernetes.io/projected/f4911d7d-5d0b-4781-8c8b-7974644adc57-kube-api-access-4rvfq\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075057    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075106    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0119068f-a141-446d-8b07-462fbdd773ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075147    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-tls\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075234    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-wtmp\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075292    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4911d7d-5d0b-4781-8c8b-7974644adc57-metrics-client-ca\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075327    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0119068f-a141-446d-8b07-462fbdd773ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.075364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.075358    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxqsd\" (UniqueName: \"kubernetes.io/projected/0119068f-a141-446d-8b07-462fbdd773ab-kube-api-access-vxqsd\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.076038 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.076010    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0119068f-a141-446d-8b07-462fbdd773ab-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.077732 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.077698    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0119068f-a141-446d-8b07-462fbdd773ab-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.077891 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.077865    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0119068f-a141-446d-8b07-462fbdd773ab-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.084136 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.084100    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxqsd\" (UniqueName: \"kubernetes.io/projected/0119068f-a141-446d-8b07-462fbdd773ab-kube-api-access-vxqsd\") pod \"openshift-state-metrics-b8f49f5c6-nxx9l\" (UID: \"0119068f-a141-446d-8b07-462fbdd773ab\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.176192 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176147    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-root\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176192 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176200    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-sys\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176223    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-accelerators-collector-config\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-textfile\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176304    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rvfq\" (UniqueName: \"kubernetes.io/projected/f4911d7d-5d0b-4781-8c8b-7974644adc57-kube-api-access-4rvfq\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176320    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-sys\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176320    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-root\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176333    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176455    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-tls\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-wtmp\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.176506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176499    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4911d7d-5d0b-4781-8c8b-7974644adc57-metrics-client-ca\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.177028 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:14:15.176602    2557 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 01:14:15.177028 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:14:15.176664    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-tls podName:f4911d7d-5d0b-4781-8c8b-7974644adc57 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:15.676643036 +0000 UTC m=+288.668608681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-tls") pod "node-exporter-j28w8" (UID: "f4911d7d-5d0b-4781-8c8b-7974644adc57") : secret "node-exporter-tls" not found
Jul 29 01:14:15.177028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-wtmp\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.177028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.176676    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-textfile\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.177028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.177017    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-accelerators-collector-config\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.177192 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.177134    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f4911d7d-5d0b-4781-8c8b-7974644adc57-metrics-client-ca\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.179017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.178984    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.185197 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.185156    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rvfq\" (UniqueName: \"kubernetes.io/projected/f4911d7d-5d0b-4781-8c8b-7974644adc57-kube-api-access-4rvfq\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.276601 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.276504    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"
Jul 29 01:14:15.414747 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.414699    2557 patch_prober.go:28] interesting pod/image-registry-547b6b79db-5qxm2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:15.414917 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.414765    2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2" podUID="dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:15.426084 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.426044    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l"]
Jul 29 01:14:15.429898 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:15.429866    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0119068f_a141_446d_8b07_462fbdd773ab.slice/crio-cb681a4b48e72d05f6d5456ec9549922e9691a2f29b452471715398a94423d48 WatchSource:0}: Error finding container cb681a4b48e72d05f6d5456ec9549922e9691a2f29b452471715398a94423d48: Status 404 returned error can't find the container with id cb681a4b48e72d05f6d5456ec9549922e9691a2f29b452471715398a94423d48
Jul 29 01:14:15.496808 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.496768    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l" event={"ID":"0119068f-a141-446d-8b07-462fbdd773ab","Type":"ContainerStarted","Data":"cb681a4b48e72d05f6d5456ec9549922e9691a2f29b452471715398a94423d48"}
Jul 29 01:14:15.681479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.681433    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-tls\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.684104 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.684061    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f4911d7d-5d0b-4781-8c8b-7974644adc57-node-exporter-tls\") pod \"node-exporter-j28w8\" (UID: \"f4911d7d-5d0b-4781-8c8b-7974644adc57\") " pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.909372 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.909324    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j28w8"
Jul 29 01:14:15.920835 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:15.920798    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4911d7d_5d0b_4781_8c8b_7974644adc57.slice/crio-51fab0e4f64aaeebd2fc5b7383bca3c13079c5e07054c7bc4af5e4065b32bbc5 WatchSource:0}: Error finding container 51fab0e4f64aaeebd2fc5b7383bca3c13079c5e07054c7bc4af5e4065b32bbc5: Status 404 returned error can't find the container with id 51fab0e4f64aaeebd2fc5b7383bca3c13079c5e07054c7bc4af5e4065b32bbc5
Jul 29 01:14:15.971948 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.971903    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:15.972473 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.971986    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:15.973572 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.973536    2557 patch_prober.go:28] interesting pod/console-f5db4c5c6-pmh2r container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused" start-of-body=
Jul 29 01:14:15.973687 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:15.973602    2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f5db4c5c6-pmh2r" podUID="67f7703b-fbc9-4463-af25-1937d6c73b14" containerName="console" probeResult="failure" output="Get \"https://10.133.0.15:8443/health\": dial tcp 10.133.0.15:8443: connect: connection refused"
Jul 29 01:14:16.502886 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:16.502844    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l" event={"ID":"0119068f-a141-446d-8b07-462fbdd773ab","Type":"ContainerStarted","Data":"5e678b0b3e9a7b5f40551e4592b7bdf48014986f48e1a8d9285698bdc53ae27f"}
Jul 29 01:14:16.503049 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:16.502962    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l" event={"ID":"0119068f-a141-446d-8b07-462fbdd773ab","Type":"ContainerStarted","Data":"597104ba4097cb181d3adad40b9e251c1879d789a8c3cbc1774837ace9b41f71"}
Jul 29 01:14:16.504320 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:16.504289    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j28w8" event={"ID":"f4911d7d-5d0b-4781-8c8b-7974644adc57","Type":"ContainerStarted","Data":"51fab0e4f64aaeebd2fc5b7383bca3c13079c5e07054c7bc4af5e4065b32bbc5"}
Jul 29 01:14:17.394478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.394437    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" containerName="registry" containerID="cri-o://8335e471924582d00b7948386b33d23ec2cc14c1ad284fe4f00453d8be40ab91" gracePeriod=30
Jul 29 01:14:17.510942 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.510902    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l" event={"ID":"0119068f-a141-446d-8b07-462fbdd773ab","Type":"ContainerStarted","Data":"9d9abcc41b0cae47b5e36ef6edbdbd1446647cf02103b16c2cc76b3d9fa42843"}
Jul 29 01:14:17.512855 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.512815    2557 generic.go:356] "Generic (PLEG): container finished" podID="f4911d7d-5d0b-4781-8c8b-7974644adc57" containerID="25e15c2ffbd49f203fea190b414892f9678e971304366587851fc5ee5ede7a8f" exitCode=0
Jul 29 01:14:17.513053 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.512904    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j28w8" event={"ID":"f4911d7d-5d0b-4781-8c8b-7974644adc57","Type":"ContainerDied","Data":"25e15c2ffbd49f203fea190b414892f9678e971304366587851fc5ee5ede7a8f"}
Jul 29 01:14:17.514767 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.514728    2557 generic.go:356] "Generic (PLEG): container finished" podID="21b73ce2-c107-49d1-9c83-b3964c406147" containerID="8335e471924582d00b7948386b33d23ec2cc14c1ad284fe4f00453d8be40ab91" exitCode=0
Jul 29 01:14:17.514905 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.514789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" event={"ID":"21b73ce2-c107-49d1-9c83-b3964c406147","Type":"ContainerDied","Data":"8335e471924582d00b7948386b33d23ec2cc14c1ad284fe4f00453d8be40ab91"}
Jul 29 01:14:17.529871 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.529806    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nxx9l" podStartSLOduration=2.623541639 podStartE2EDuration="3.529789636s" totalImagesPullingTime="906.247997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:17.52861614 +0000 UTC m=+290.520581810" watchObservedRunningTime="2026-07-29 01:14:17.529789636 +0000 UTC m=+290.521755305"
Jul 29 01:14:17.669819 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.669780    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:14:17.701878 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.701839    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9mm6\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-kube-api-access-h9mm6\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.701878 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.701885    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-bound-sa-token\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.701924    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.701943    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-image-registry-private-configuration\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.701988    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21b73ce2-c107-49d1-9c83-b3964c406147-ca-trust-extracted\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.702009    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-registry-certificates\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.702027    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-installation-pull-secrets\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702140 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.702065    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-trusted-ca\") pod \"21b73ce2-c107-49d1-9c83-b3964c406147\" (UID: \"21b73ce2-c107-49d1-9c83-b3964c406147\") "
Jul 29 01:14:17.702697 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.702640    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:17.703141 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.703104    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:14:17.705019 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.704971    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-kube-api-access-h9mm6" (OuterVolumeSpecName: "kube-api-access-h9mm6") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "kube-api-access-h9mm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:17.705865 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.705670    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:17.705865 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.705775    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:17.705865 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.705835    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:14:17.706126 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.705942    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:14:17.712625 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.712578    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21b73ce2-c107-49d1-9c83-b3964c406147-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "21b73ce2-c107-49d1-9c83-b3964c406147" (UID: "21b73ce2-c107-49d1-9c83-b3964c406147"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:14:17.803654 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803604    2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-registry-certificates\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803654 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803644    2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-installation-pull-secrets\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803654 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803659    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21b73ce2-c107-49d1-9c83-b3964c406147-trusted-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803669    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9mm6\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-kube-api-access-h9mm6\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803678    2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-bound-sa-token\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803687    2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/21b73ce2-c107-49d1-9c83-b3964c406147-registry-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803696    2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/21b73ce2-c107-49d1-9c83-b3964c406147-image-registry-private-configuration\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.803901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.803706    2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/21b73ce2-c107-49d1-9c83-b3964c406147-ca-trust-extracted\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:14:17.924586 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.924489    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-585dc5459f-d6wrm"]
Jul 29 01:14:17.924770 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.924757    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" containerName="registry"
Jul 29 01:14:17.924770 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.924770    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" containerName="registry"
Jul 29 01:14:17.924845 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.924818    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" containerName="registry"
Jul 29 01:14:17.929930 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.929904    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932808    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-795tz\""
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932816    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932852    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932880    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932881    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-evkher99uk922\""
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932926    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 29 01:14:17.933043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.932884    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 29 01:14:17.940874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:17.940839    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-585dc5459f-d6wrm"]
Jul 29 01:14:18.006053 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006003    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006053 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006055    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006082    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006105    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006133    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-grpc-tls\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006205    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94m26\" (UniqueName: \"kubernetes.io/projected/ffbb0772-f706-4df2-a4f0-5e7afef956c7-kube-api-access-94m26\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006235    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffbb0772-f706-4df2-a4f0-5e7afef956c7-metrics-client-ca\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.006317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.006295    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-tls\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107488 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107428    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107488 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107494    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107654    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107734 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107685    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-grpc-tls\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107765 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107741    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94m26\" (UniqueName: \"kubernetes.io/projected/ffbb0772-f706-4df2-a4f0-5e7afef956c7-kube-api-access-94m26\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107808 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107797    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffbb0772-f706-4df2-a4f0-5e7afef956c7-metrics-client-ca\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.107878 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.107854    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-tls\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.108834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.108794    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffbb0772-f706-4df2-a4f0-5e7afef956c7-metrics-client-ca\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.110528 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.110487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.110680 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.110487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.110750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.110724    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.110797 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.110760    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-grpc-tls\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.110797 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.110791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-tls\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.110868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.110805    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffbb0772-f706-4df2-a4f0-5e7afef956c7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.116680 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.116646    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94m26\" (UniqueName: \"kubernetes.io/projected/ffbb0772-f706-4df2-a4f0-5e7afef956c7-kube-api-access-94m26\") pod \"thanos-querier-585dc5459f-d6wrm\" (UID: \"ffbb0772-f706-4df2-a4f0-5e7afef956c7\") " pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.241487 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.241439    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:18.393336 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.393241    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-585dc5459f-d6wrm"]
Jul 29 01:14:18.397422 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:18.397385    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffbb0772_f706_4df2_a4f0_5e7afef956c7.slice/crio-8214d55854f3369b4a71bcd71e683427ce35f9270cb0f5cf81c88129870c230a WatchSource:0}: Error finding container 8214d55854f3369b4a71bcd71e683427ce35f9270cb0f5cf81c88129870c230a: Status 404 returned error can't find the container with id 8214d55854f3369b4a71bcd71e683427ce35f9270cb0f5cf81c88129870c230a
Jul 29 01:14:18.525884 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.525766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j28w8" event={"ID":"f4911d7d-5d0b-4781-8c8b-7974644adc57","Type":"ContainerStarted","Data":"c58193e1a8f9f1a3dfe26490a83fef2fd482dafbdebccc8d37fa3a56d594c390"}
Jul 29 01:14:18.525884 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.525869    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j28w8" event={"ID":"f4911d7d-5d0b-4781-8c8b-7974644adc57","Type":"ContainerStarted","Data":"2cc3bdd91dbb5976f6489d7ab3de9a483e2215325967f7b79d931cd3f613fced"}
Jul 29 01:14:18.527247 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.527216    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"8214d55854f3369b4a71bcd71e683427ce35f9270cb0f5cf81c88129870c230a"}
Jul 29 01:14:18.528729 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.528696    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj"
Jul 29 01:14:18.528729 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.528703    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6785847fcd-lzwtj" event={"ID":"21b73ce2-c107-49d1-9c83-b3964c406147","Type":"ContainerDied","Data":"aff40a466c9bedc3ef714626c27ac49c3e4569ea16a945fd19fc513aaf2e7f80"}
Jul 29 01:14:18.528905 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.528777    2557 scope.go:117] "RemoveContainer" containerID="8335e471924582d00b7948386b33d23ec2cc14c1ad284fe4f00453d8be40ab91"
Jul 29 01:14:18.544924 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.544854    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j28w8" podStartSLOduration=3.3530890749999998 podStartE2EDuration="4.544832564s" totalImagesPullingTime="1.110689836s" totalInitContainerRuntime="81.053653ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:18.543557219 +0000 UTC m=+291.535522901" watchObservedRunningTime="2026-07-29 01:14:18.544832564 +0000 UTC m=+291.536798291"
Jul 29 01:14:18.559489 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.559446    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6785847fcd-lzwtj"]
Jul 29 01:14:18.563004 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:18.562963    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6785847fcd-lzwtj"]
Jul 29 01:14:19.356771 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.356729    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54459b45f8-r4gks"]
Jul 29 01:14:19.359913 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.359880    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.362652 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.362522    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 29 01:14:19.362652 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.362564    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 01:14:19.362652 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.362584    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 29 01:14:19.363668 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.363642    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1n2n20k8chjp3\""
Jul 29 01:14:19.363846 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.363642    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 29 01:14:19.363846 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.363648    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-qxrck\""
Jul 29 01:14:19.370239 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.370204    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54459b45f8-r4gks"]
Jul 29 01:14:19.420916 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.420864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ftr\" (UniqueName: \"kubernetes.io/projected/49b1486a-6e84-481a-a665-23fda7a3f404-kube-api-access-27ftr\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.421425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.420925    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-secret-metrics-server-tls\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.421425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.421013    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b1486a-6e84-481a-a665-23fda7a3f404-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.421425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.421047    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49b1486a-6e84-481a-a665-23fda7a3f404-audit-log\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.421425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.421078    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-secret-metrics-server-client-certs\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.421425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.421212    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-client-ca-bundle\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.421425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.421388    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49b1486a-6e84-481a-a665-23fda7a3f404-metrics-server-audit-profiles\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.522598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522546    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b1486a-6e84-481a-a665-23fda7a3f404-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.522598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522587    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49b1486a-6e84-481a-a665-23fda7a3f404-audit-log\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.522847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522545    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21b73ce2-c107-49d1-9c83-b3964c406147" path="/var/lib/kubelet/pods/21b73ce2-c107-49d1-9c83-b3964c406147/volumes"
Jul 29 01:14:19.522847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522613    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-secret-metrics-server-client-certs\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.522847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522757    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-client-ca-bundle\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.522847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522803    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49b1486a-6e84-481a-a665-23fda7a3f404-metrics-server-audit-profiles\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.522847 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.522836    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ftr\" (UniqueName: \"kubernetes.io/projected/49b1486a-6e84-481a-a665-23fda7a3f404-kube-api-access-27ftr\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.523107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.523072    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/49b1486a-6e84-481a-a665-23fda7a3f404-audit-log\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.523160 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.523139    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-secret-metrics-server-tls\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.523651 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.523621    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49b1486a-6e84-481a-a665-23fda7a3f404-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.523818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.523796    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/49b1486a-6e84-481a-a665-23fda7a3f404-metrics-server-audit-profiles\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.525506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.525473    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-secret-metrics-server-client-certs\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.525672 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.525487    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-client-ca-bundle\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.525672 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.525545    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/49b1486a-6e84-481a-a665-23fda7a3f404-secret-metrics-server-tls\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.532823 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.532791    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ftr\" (UniqueName: \"kubernetes.io/projected/49b1486a-6e84-481a-a665-23fda7a3f404-kube-api-access-27ftr\") pod \"metrics-server-54459b45f8-r4gks\" (UID: \"49b1486a-6e84-481a-a665-23fda7a3f404\") " pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.674027 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.673919    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:19.852475 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:19.852366    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54459b45f8-r4gks"]
Jul 29 01:14:20.164328 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.164281    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6664d46979-ngcwt"]
Jul 29 01:14:20.180060 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.180010    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6664d46979-ngcwt"]
Jul 29 01:14:20.180276 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.180178    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.182927 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.182882    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 01:14:20.182927 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.182912    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 01:14:20.182927 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.182882    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wpt8z\""
Jul 29 01:14:20.183215 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.183068    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 01:14:20.183215 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.183102    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 01:14:20.183383 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.183359    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 01:14:20.188041 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.188006    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 01:14:20.231676 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231633    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-secret-telemeter-client\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.231874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231705    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.231874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231738    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.231874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231764    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-metrics-client-ca\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.231874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231864    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-telemeter-client-tls\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.232091 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231910    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn2jh\" (UniqueName: \"kubernetes.io/projected/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-kube-api-access-wn2jh\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.232091 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.231991    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-serving-certs-ca-bundle\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.232091 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.232063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-federate-client-tls\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.332962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.332921    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.332985    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-metrics-client-ca\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333040    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-telemeter-client-tls\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333059    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn2jh\" (UniqueName: \"kubernetes.io/projected/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-kube-api-access-wn2jh\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333095    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-serving-certs-ca-bundle\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333142    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-federate-client-tls\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333170    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-secret-telemeter-client\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333232    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333854 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333825    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-metrics-client-ca\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.333962 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.333868    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-serving-certs-ca-bundle\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.334165 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.334078    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.336331 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.336293    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.336541 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.336519    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-secret-telemeter-client\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.336598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.336564    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-telemeter-client-tls\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.336598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.336577    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-federate-client-tls\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.341563 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.341526    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn2jh\" (UniqueName: \"kubernetes.io/projected/36fec6b6-d06b-4e7e-ba97-7ec1d034621a-kube-api-access-wn2jh\") pod \"telemeter-client-6664d46979-ngcwt\" (UID: \"36fec6b6-d06b-4e7e-ba97-7ec1d034621a\") " pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.399025 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:20.398978    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b1486a_6e84_481a_a665_23fda7a3f404.slice/crio-681a32446b8bc5ad5c66f7161c2c53338897aee95e167e2d64e70c71a023bca0 WatchSource:0}: Error finding container 681a32446b8bc5ad5c66f7161c2c53338897aee95e167e2d64e70c71a023bca0: Status 404 returned error can't find the container with id 681a32446b8bc5ad5c66f7161c2c53338897aee95e167e2d64e70c71a023bca0
Jul 29 01:14:20.495532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.495430    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt"
Jul 29 01:14:20.539687 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.539651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks" event={"ID":"49b1486a-6e84-481a-a665-23fda7a3f404","Type":"ContainerStarted","Data":"681a32446b8bc5ad5c66f7161c2c53338897aee95e167e2d64e70c71a023bca0"}
Jul 29 01:14:20.745226 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:20.745196    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6664d46979-ngcwt"]
Jul 29 01:14:20.750098 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:20.750062    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fec6b6_d06b_4e7e_ba97_7ec1d034621a.slice/crio-55a337d3a5d3f5645e0a0c80cb9df3effbe513a829f2e07462f4044e3f3aa754 WatchSource:0}: Error finding container 55a337d3a5d3f5645e0a0c80cb9df3effbe513a829f2e07462f4044e3f3aa754: Status 404 returned error can't find the container with id 55a337d3a5d3f5645e0a0c80cb9df3effbe513a829f2e07462f4044e3f3aa754
Jul 29 01:14:21.125216 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.125166    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:14:21.162965 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.162926    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:14:21.163136 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.163061    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.166149 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.166114    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.166695    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.166797    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.166796    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.166984    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k6gsd\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167071    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167080    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167101    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 01:14:21.167210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167099    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bpge5algeouqg\""
Jul 29 01:14:21.167662 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167286    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 01:14:21.167662 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167381    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 01:14:21.167662 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167457    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 01:14:21.167662 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.167504    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 01:14:21.168424 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.168182    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 01:14:21.170679 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.170596    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 01:14:21.173421 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.173385    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 01:14:21.242661 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242620    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.242851 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242696    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.242851 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242727    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.242851 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242758    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.242851 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242819    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243066 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshdl\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-kube-api-access-lshdl\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243066 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.242889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243193 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243158    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243287 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243244    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243370 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243328    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243419 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243382    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-web-config\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243419 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243411    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-config-out\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243526 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243427    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243526 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243445    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-config\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243526 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243470    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243564    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243593    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243648    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243797 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243684    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.243797 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.243732    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.344691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344643    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.344691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344693    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.344948 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344712    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.344948 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.344948 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344860    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lshdl\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-kube-api-access-lshdl\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.344948 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344906    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.344967    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345009    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345038    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345067    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-web-config\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345103    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-config-out\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345130    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345142    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345160    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-config\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345198    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345240 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345314    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345363    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345414    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345483    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.345743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.345706    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.346095 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.346063    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.346742 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.346389    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.346742 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.346702    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.348244 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.348203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.348415 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.348203    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-web-config\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.348415 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.348199    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.348415 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.348373    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.348415 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.348386    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.348694 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.348647    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.349182 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.349106    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.349544 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.349518    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-config\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.349681 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.349654    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.349915 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.349890    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.350863 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.350835    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-config-out\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.350984 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.350963    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.351469 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.351442    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.351823 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.351797    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.353723 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.353696    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshdl\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-kube-api-access-lshdl\") pod \"prometheus-k8s-0\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.478733 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.478621    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:21.517668 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:14:21.517612    2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rdb8t" podUID="3e6d744d-8d4e-4697-89a2-7b343e495e0d"
Jul 29 01:14:21.553645 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.553440    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"9b1c6f233199fcd0af08f02bb832894b39436a43cf875659de8d6f106de0f1e5"}
Jul 29 01:14:21.553645 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.553534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"2c0c95871cee7f69fb5dcfb91b61e2a89c5e51d936429ce431923caff31cbba0"}
Jul 29 01:14:21.553645 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.553580    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"9cbb84c5f9cf5f7cb0ef3997c605eb347f4d6b20ff3f1bef23a4c6652b8c859e"}
Jul 29 01:14:21.555680 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:21.555633    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt" event={"ID":"36fec6b6-d06b-4e7e-ba97-7ec1d034621a","Type":"ContainerStarted","Data":"55a337d3a5d3f5645e0a0c80cb9df3effbe513a829f2e07462f4044e3f3aa754"}
Jul 29 01:14:22.727863 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:22.727759    2557 patch_prober.go:28] interesting pod/image-registry-547b6b79db-5qxm2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:14:22.727863 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:22.727826    2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2" podUID="dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:14:23.139223 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.139190    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:14:23.144446 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:14:23.144388    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342d95ad_8a8e_4afb_a1ad_36014cb03677.slice/crio-4a13664e52548cb80c58c8a1f1bfc81b1be379da683c9f80604f18173b87912d WatchSource:0}: Error finding container 4a13664e52548cb80c58c8a1f1bfc81b1be379da683c9f80604f18173b87912d: Status 404 returned error can't find the container with id 4a13664e52548cb80c58c8a1f1bfc81b1be379da683c9f80604f18173b87912d
Jul 29 01:14:23.494808 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.494715    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bbjfc"
Jul 29 01:14:23.571146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.571104    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"9c0565b7b08e34c859481c33f615a148e811b3dd3afa716b6d192e61f298cea5"}
Jul 29 01:14:23.571362 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.571195    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"000a07900a972e5b80a3984cb81d4315de631b291df62687ea02488840827c60"}
Jul 29 01:14:23.571362 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.571234    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" event={"ID":"ffbb0772-f706-4df2-a4f0-5e7afef956c7","Type":"ContainerStarted","Data":"bb6b15955e11356e013603acf3dfe9ff836eec3ffeefc56589380adea99e8f3e"}
Jul 29 01:14:23.571362 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.571304    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:23.573353 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.573311    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks" event={"ID":"49b1486a-6e84-481a-a665-23fda7a3f404","Type":"ContainerStarted","Data":"9b46585b1d591ed559db56cb97cb9d5b74935b3a50a36efed00fa4505dd15f87"}
Jul 29 01:14:23.575094 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.575051    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"4a13664e52548cb80c58c8a1f1bfc81b1be379da683c9f80604f18173b87912d"}
Jul 29 01:14:23.577105 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.577066    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt" event={"ID":"36fec6b6-d06b-4e7e-ba97-7ec1d034621a","Type":"ContainerStarted","Data":"2a7ee81deacb0ece5111a97c05201e09b2123bff1c3a5477969f56ddca7333e5"}
Jul 29 01:14:23.594518 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.594416    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm" podStartSLOduration=2.302791841 podStartE2EDuration="6.594390316s" totalImagesPullingTime="4.291598475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:23.593419337 +0000 UTC m=+296.585385007" watchObservedRunningTime="2026-07-29 01:14:23.594390316 +0000 UTC m=+296.586355985"
Jul 29 01:14:23.610835 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:23.610766    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks" podStartSLOduration=2.031406653 podStartE2EDuration="4.610739593s" totalImagesPullingTime="2.57933294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:23.609852426 +0000 UTC m=+296.601818131" watchObservedRunningTime="2026-07-29 01:14:23.610739593 +0000 UTC m=+296.602705262"
Jul 29 01:14:25.414793 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.414758    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-547b6b79db-5qxm2"
Jul 29 01:14:25.587727 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.587675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt" event={"ID":"36fec6b6-d06b-4e7e-ba97-7ec1d034621a","Type":"ContainerStarted","Data":"12137074eb3891ca764fd52b4dce92bbe2abbae6bd92b46611e3511030206930"}
Jul 29 01:14:25.587924 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.587755    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt" event={"ID":"36fec6b6-d06b-4e7e-ba97-7ec1d034621a","Type":"ContainerStarted","Data":"eeabff13b02896ab0613d494f548402a4185ab478017f629bbb46c504589a13a"}
Jul 29 01:14:25.589634 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.589601    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1" exitCode=0
Jul 29 01:14:25.589751 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.589648    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"}
Jul 29 01:14:25.609204 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.609136    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6664d46979-ngcwt" podStartSLOduration=1.838705865 podStartE2EDuration="5.609117677s" totalImagesPullingTime="3.770411812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:25.60742962 +0000 UTC m=+298.599395292" watchObservedRunningTime="2026-07-29 01:14:25.609117677 +0000 UTC m=+298.601083344"
Jul 29 01:14:25.976578 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.976535    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:25.980946 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:25.980909    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:14:27.456967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:27.456939    2557 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:14:29.588159 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.588125    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-585dc5459f-d6wrm"
Jul 29 01:14:29.616368 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.616328    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"}
Jul 29 01:14:29.616548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.616403    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"}
Jul 29 01:14:29.616548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.616429    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"}
Jul 29 01:14:29.616548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.616455    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"}
Jul 29 01:14:29.616548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.616480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"}
Jul 29 01:14:29.616548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.616504    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerStarted","Data":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"}
Jul 29 01:14:29.646276 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:29.646195    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.201162071 podStartE2EDuration="8.646171207s" totalImagesPullingTime="4.435965511s" totalInitContainerRuntime="9.043625ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:29.643547203 +0000 UTC m=+302.635512875" watchObservedRunningTime="2026-07-29 01:14:29.646171207 +0000 UTC m=+302.638136876"
Jul 29 01:14:31.479467 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:31.479411    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:14:32.517193 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:32.517154    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:14:35.648319 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:35.648238    2557 generic.go:356] "Generic (PLEG): container finished" podID="95fbc2fa-5f95-40b9-85ac-8add3aee4faf" containerID="df407d2c170bc946725c5e1e79331796c3a7afc7b7a5479429feb5c48da4fb91" exitCode=0
Jul 29 01:14:35.648720 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:35.648325    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49" event={"ID":"95fbc2fa-5f95-40b9-85ac-8add3aee4faf","Type":"ContainerDied","Data":"df407d2c170bc946725c5e1e79331796c3a7afc7b7a5479429feb5c48da4fb91"}
Jul 29 01:14:35.648720 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:35.648713    2557 scope.go:117] "RemoveContainer" containerID="df407d2c170bc946725c5e1e79331796c3a7afc7b7a5479429feb5c48da4fb91"
Jul 29 01:14:36.654565 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:36.654526    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-rjs49" event={"ID":"95fbc2fa-5f95-40b9-85ac-8add3aee4faf","Type":"ContainerStarted","Data":"5e4ff14f9ac8a8e02bd88189127703dc202b9243b02a61909801afd6154c7917"}
Jul 29 01:14:37.816931 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:37.816886    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f5db4c5c6-pmh2r"]
Jul 29 01:14:39.675025 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:39.674966    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:39.675500 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:39.675058    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:58.634873 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:58.634835    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d9b86687-ssxmq_4ad08486-9b66-4bea-ab14-3498da5c3a4d/router/0.log"
Jul 29 01:14:58.659000 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:58.658969    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wk42l_1acebcd2-7200-4d28-9564-f7e74ca99209/serve-healthcheck-canary/0.log"
Jul 29 01:14:59.680220 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:59.680181    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:14:59.684548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:14:59.684513    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54459b45f8-r4gks"
Jul 29 01:15:02.838596 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:02.838554    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f5db4c5c6-pmh2r" podUID="67f7703b-fbc9-4463-af25-1937d6c73b14" containerName="console" containerID="cri-o://62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47" gracePeriod=15
Jul 29 01:15:03.128416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.128380    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:15:03.258565 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258520    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-trusted-ca-bundle\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.258756 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258578    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-oauth-serving-cert\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.258756 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258610    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-serving-cert\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.258756 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258636    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvc7r\" (UniqueName: \"kubernetes.io/projected/67f7703b-fbc9-4463-af25-1937d6c73b14-kube-api-access-jvc7r\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.258756 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258671    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-service-ca\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.258756 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258710    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-console-config\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.258998 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.258881    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-oauth-config\") pod \"67f7703b-fbc9-4463-af25-1937d6c73b14\" (UID: \"67f7703b-fbc9-4463-af25-1937d6c73b14\") "
Jul 29 01:15:03.259191 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259039    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:03.259191 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259159    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:03.259408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-console-config" (OuterVolumeSpecName: "console-config") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:03.259408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259220    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-service-ca" (OuterVolumeSpecName: "service-ca") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:03.259408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259337    2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-trusted-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.259408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259351    2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-oauth-serving-cert\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.259408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259372    2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.259408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.259382    2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/67f7703b-fbc9-4463-af25-1937d6c73b14-console-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.261384 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.261339    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:03.261633 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.261604    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:03.261746 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.261627    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67f7703b-fbc9-4463-af25-1937d6c73b14-kube-api-access-jvc7r" (OuterVolumeSpecName: "kube-api-access-jvc7r") pod "67f7703b-fbc9-4463-af25-1937d6c73b14" (UID: "67f7703b-fbc9-4463-af25-1937d6c73b14"). InnerVolumeSpecName "kube-api-access-jvc7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:03.360594 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.360548    2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-oauth-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.360594 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.360591    2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/67f7703b-fbc9-4463-af25-1937d6c73b14-console-serving-cert\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.360594 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.360602    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvc7r\" (UniqueName: \"kubernetes.io/projected/67f7703b-fbc9-4463-af25-1937d6c73b14-kube-api-access-jvc7r\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:03.785021 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.784922    2557 generic.go:356] "Generic (PLEG): container finished" podID="67f7703b-fbc9-4463-af25-1937d6c73b14" containerID="62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47" exitCode=0
Jul 29 01:15:03.785021 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.784978    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f5db4c5c6-pmh2r"
Jul 29 01:15:03.785021 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.785002    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5db4c5c6-pmh2r" event={"ID":"67f7703b-fbc9-4463-af25-1937d6c73b14","Type":"ContainerDied","Data":"62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47"}
Jul 29 01:15:03.785323 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.785046    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f5db4c5c6-pmh2r" event={"ID":"67f7703b-fbc9-4463-af25-1937d6c73b14","Type":"ContainerDied","Data":"7dc8dcb2fac6aa57ef5d9d4186b4e783a0edb9d14ff828bcdd29b34a90946321"}
Jul 29 01:15:03.785323 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.785070    2557 scope.go:117] "RemoveContainer" containerID="62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47"
Jul 29 01:15:03.794945 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.794916    2557 scope.go:117] "RemoveContainer" containerID="62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47"
Jul 29 01:15:03.795400 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:03.795371    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47\": container with ID starting with 62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47 not found: ID does not exist" containerID="62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47"
Jul 29 01:15:03.795487 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.795412    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47"} err="failed to get container status \"62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47\": rpc error: code = NotFound desc = could not find container \"62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47\": container with ID starting with 62a4d94f03a12a727e1d86abfcbeb7331e0b9bbf6cc15463ffdbb5151f0f6b47 not found: ID does not exist"
Jul 29 01:15:03.803752 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.803707    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f5db4c5c6-pmh2r"]
Jul 29 01:15:03.807112 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:03.807071    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f5db4c5c6-pmh2r"]
Jul 29 01:15:05.522650 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:05.522595    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67f7703b-fbc9-4463-af25-1937d6c73b14" path="/var/lib/kubelet/pods/67f7703b-fbc9-4463-af25-1937d6c73b14/volumes"
Jul 29 01:15:21.478849 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:21.478742    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:21.497374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:21.497335    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:21.882668 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:21.882634    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:39.559702 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.559647    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:39.560213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.559985    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="prometheus" containerID="cri-o://706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953" gracePeriod=600
Jul 29 01:15:39.560213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.560033    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy" containerID="cri-o://db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385" gracePeriod=600
Jul 29 01:15:39.560213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.560082    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="config-reloader" containerID="cri-o://b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82" gracePeriod=600
Jul 29 01:15:39.560213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.560039    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="thanos-sidecar" containerID="cri-o://b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940" gracePeriod=600
Jul 29 01:15:39.560213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.560070    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-web" containerID="cri-o://db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69" gracePeriod=600
Jul 29 01:15:39.560213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.560107    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-thanos" containerID="cri-o://48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406" gracePeriod=600
Jul 29 01:15:39.821949 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.821907    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:39.909814 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.909762    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-db\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.909827    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.909870    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-web-config\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.909897    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.909967    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-2\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910011    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-kube-rbac-proxy\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910308 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910059    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-config-out\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910422 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910381    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.910422 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910087    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-thanos-prometheus-http-client-file\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910557 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910460    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-config\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910557 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910486    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-grpc-tls\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910557 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910521    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-metrics-client-certs\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910557 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910546    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-metrics-client-ca\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910577    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-tls-assets\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910619    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-kubelet-serving-ca-bundle\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910652    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-trusted-ca-bundle\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910692    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lshdl\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-kube-api-access-lshdl\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910722    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-tls\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.910759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910746    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-serving-certs-ca-bundle\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.911067 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910779    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-0\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.911067 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.910805    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-1\") pod \"342d95ad-8a8e-4afb-a1ad-36014cb03677\" (UID: \"342d95ad-8a8e-4afb-a1ad-36014cb03677\") "
Jul 29 01:15:39.911172 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.911144    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:39.911566 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.911530    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.911693 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.911597    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.912077 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.912041    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.912171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.912152    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:39.912681 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.912645    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.913239 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913203    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-config-out" (OuterVolumeSpecName: "config-out") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:39.913604 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913562    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.913711 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913679    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.913961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913855    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.913961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913914    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:39.913961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913931    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.914120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.913967    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.915573 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.915536    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:39.915573 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.915557    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-config" (OuterVolumeSpecName: "config") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.915774 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.915721    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.916228 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.916196    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.916347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.916215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.916347 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.916215    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-kube-api-access-lshdl" (OuterVolumeSpecName: "kube-api-access-lshdl") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "kube-api-access-lshdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:39.927145 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.927093    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-web-config" (OuterVolumeSpecName: "web-config") pod "342d95ad-8a8e-4afb-a1ad-36014cb03677" (UID: "342d95ad-8a8e-4afb-a1ad-36014cb03677"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:39.943212 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943171    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406" exitCode=0
Jul 29 01:15:39.943212 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943207    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385" exitCode=0
Jul 29 01:15:39.943212 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943216    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69" exitCode=0
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943225    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940" exitCode=0
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943234    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82" exitCode=0
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943244    2557 generic.go:356] "Generic (PLEG): container finished" podID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953" exitCode=0
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943244    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"}
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943295    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943401    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"}
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943438    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"}
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943466    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"}
Jul 29 01:15:39.943479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943476    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:39.943796 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943492    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"}
Jul 29 01:15:39.943796 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943519    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"}
Jul 29 01:15:39.943796 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.943547    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"342d95ad-8a8e-4afb-a1ad-36014cb03677","Type":"ContainerDied","Data":"4a13664e52548cb80c58c8a1f1bfc81b1be379da683c9f80604f18173b87912d"}
Jul 29 01:15:39.952337 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.952307    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:39.961120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.961094    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:39.968362 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.968318    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:39.970363 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.970298    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:39.973765 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.973673    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:39.981548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.981522    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:39.990783 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.990756    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:39.996857 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.996823    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:39.997129 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997115    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-web"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997130    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-web"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997137    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67f7703b-fbc9-4463-af25-1937d6c73b14" containerName="console"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997143    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="67f7703b-fbc9-4463-af25-1937d6c73b14" containerName="console"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997155    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="thanos-sidecar"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997161    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="thanos-sidecar"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997167    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-thanos"
Jul 29 01:15:39.997176 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997173    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-thanos"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997183    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="init-config-reloader"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997188    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="init-config-reloader"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997195    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="config-reloader"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997200    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="config-reloader"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997207    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997213    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997222    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="prometheus"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997226    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="prometheus"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997284    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="config-reloader"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997293    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-thanos"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997300    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="67f7703b-fbc9-4463-af25-1937d6c73b14" containerName="console"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997305    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997312    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="thanos-sidecar"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997318    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="kube-rbac-proxy-web"
Jul 29 01:15:39.997411 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:39.997324    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" containerName="prometheus"
Jul 29 01:15:40.000692 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.000670    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.001897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.001877    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.004636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.004571    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 01:15:40.004636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.004631    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 01:15:40.004943 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.004683    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bpge5algeouqg\""
Jul 29 01:15:40.004943 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.004814    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 01:15:40.004943 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.004848    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 01:15:40.005118 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005051    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 01:15:40.005196 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005180    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 01:15:40.005532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005504    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 01:15:40.005532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005523    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 01:15:40.005532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005529    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 01:15:40.005972 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005948    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-k6gsd\""
Jul 29 01:15:40.006087 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.005953    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 01:15:40.006919 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.006798    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 01:15:40.006919 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.006897    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 01:15:40.008919 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.008892    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 01:15:40.010500 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.010472    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 01:15:40.010940 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.010915    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.011320 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.011290    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.011444 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011332    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"} err="failed to get container status \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist"
Jul 29 01:15:40.011444 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011380    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011680    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011706    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011722    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-k8s-db\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011736    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011750    2557 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-web-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011765    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011779    2557 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-kube-rbac-proxy\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011794    2557 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/342d95ad-8a8e-4afb-a1ad-36014cb03677-config-out\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011807    2557 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011821    2557 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.011834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011835    2557 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-grpc-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011849    2557 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-metrics-client-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011863    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-metrics-client-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011875    2557 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-tls-assets\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011889    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011903    2557 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011917    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lshdl\" (UniqueName: \"kubernetes.io/projected/342d95ad-8a8e-4afb-a1ad-36014cb03677-kube-api-access-lshdl\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011930    2557 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/342d95ad-8a8e-4afb-a1ad-36014cb03677-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011945    2557 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/342d95ad-8a8e-4afb-a1ad-36014cb03677-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.011950    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011979    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"} err="failed to get container status \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist"
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.011997    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.012251    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.012295    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"} err="failed to get container status \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist"
Jul 29 01:15:40.012443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.012320    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.013028 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.012611    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.013028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.012630    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"} err="failed to get container status \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist"
Jul 29 01:15:40.013028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.012645    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.013028 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.012858    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.013028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.012875    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"} err="failed to get container status \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist"
Jul 29 01:15:40.013028 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.012888    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.013212 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.013108    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.013212 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013133    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"} err="failed to get container status \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist"
Jul 29 01:15:40.013212 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013149    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.013438 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:15:40.013421    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.013481 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013442    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"} err="failed to get container status \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist"
Jul 29 01:15:40.013481 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013458    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.013731 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013710    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"} err="failed to get container status \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist"
Jul 29 01:15:40.013816 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013733    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.013984 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013967    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"} err="failed to get container status \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist"
Jul 29 01:15:40.014034 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.013985    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.014209 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014190    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"} err="failed to get container status \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist"
Jul 29 01:15:40.014276 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014209    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.014504 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014480    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"} err="failed to get container status \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist"
Jul 29 01:15:40.014561 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014506    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.014728 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014709    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"} err="failed to get container status \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist"
Jul 29 01:15:40.014777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014728    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.014981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014960    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"} err="failed to get container status \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist"
Jul 29 01:15:40.015033 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.014982    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.015202 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.015185    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"} err="failed to get container status \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist"
Jul 29 01:15:40.015356 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.015202    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.015474 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.015455    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"} err="failed to get container status \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist"
Jul 29 01:15:40.015521 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.015474    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.015698 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.015678    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"} err="failed to get container status \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist"
Jul 29 01:15:40.015778 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.015700    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.016061 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016027    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"} err="failed to get container status \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist"
Jul 29 01:15:40.016061 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016051    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.016360 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016332    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"} err="failed to get container status \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist"
Jul 29 01:15:40.016446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016362    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.016703 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016676    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"} err="failed to get container status \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist"
Jul 29 01:15:40.016813 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016704    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.016991 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016968    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"} err="failed to get container status \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist"
Jul 29 01:15:40.017058 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.016991    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.017305 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.017283    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"} err="failed to get container status \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist"
Jul 29 01:15:40.017390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.017304    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.017563 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.017541    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"} err="failed to get container status \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist"
Jul 29 01:15:40.017647 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.017566    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.017841 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.017816    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"} err="failed to get container status \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist"
Jul 29 01:15:40.017841 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.017838    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.018116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018087    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"} err="failed to get container status \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist"
Jul 29 01:15:40.018116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018116    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.018396 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018370    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"} err="failed to get container status \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist"
Jul 29 01:15:40.018396 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018393    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.018658 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018637    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"} err="failed to get container status \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist"
Jul 29 01:15:40.018737 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018660    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.018932 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018913    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"} err="failed to get container status \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist"
Jul 29 01:15:40.018986 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.018934    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.019052 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019027    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:40.019175 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019156    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"} err="failed to get container status \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist"
Jul 29 01:15:40.019220 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019176    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.019445 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019423    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"} err="failed to get container status \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist"
Jul 29 01:15:40.019445 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019442    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.019687 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019668    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"} err="failed to get container status \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist"
Jul 29 01:15:40.019752 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019689    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.019945 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019924    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"} err="failed to get container status \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist"
Jul 29 01:15:40.019945 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.019943    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.020184 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.020162    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"} err="failed to get container status \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist"
Jul 29 01:15:40.020184 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.020184    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.020484 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.020457    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"} err="failed to get container status \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist"
Jul 29 01:15:40.020587 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.020484    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.020815 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.020783    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"} err="failed to get container status \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist"
Jul 29 01:15:40.020889 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.020817    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.021103 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021080    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"} err="failed to get container status \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist"
Jul 29 01:15:40.021209 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021106    2557 scope.go:117] "RemoveContainer" containerID="48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"
Jul 29 01:15:40.021408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021381    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406"} err="failed to get container status \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": rpc error: code = NotFound desc = could not find container \"48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406\": container with ID starting with 48b4c2c1970d2b7d17966eb82cb38b40c9447dc7900778ae3def711e38da5406 not found: ID does not exist"
Jul 29 01:15:40.021408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021408    2557 scope.go:117] "RemoveContainer" containerID="db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"
Jul 29 01:15:40.021652 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021629    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385"} err="failed to get container status \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": rpc error: code = NotFound desc = could not find container \"db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385\": container with ID starting with db13f8fff90e889aff3d0a8d857228fd3758de8c6ce24707547dfc4a84f18385 not found: ID does not exist"
Jul 29 01:15:40.021652 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021651    2557 scope.go:117] "RemoveContainer" containerID="db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"
Jul 29 01:15:40.021933 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021912    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69"} err="failed to get container status \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": rpc error: code = NotFound desc = could not find container \"db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69\": container with ID starting with db560bfc1c278aecece1df97e903a672fcc74153736d04b1e49ffeeaf1854e69 not found: ID does not exist"
Jul 29 01:15:40.022018 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.021936    2557 scope.go:117] "RemoveContainer" containerID="b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"
Jul 29 01:15:40.022238 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.022213    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940"} err="failed to get container status \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": rpc error: code = NotFound desc = could not find container \"b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940\": container with ID starting with b14c2e45f1196bf045601ad9881ed9598f1846674d1728614f1e994704a34940 not found: ID does not exist"
Jul 29 01:15:40.022342 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.022239    2557 scope.go:117] "RemoveContainer" containerID="b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"
Jul 29 01:15:40.022569 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.022549    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82"} err="failed to get container status \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": rpc error: code = NotFound desc = could not find container \"b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82\": container with ID starting with b3b7a74282978896d9609f8737b84ff52424b86185dd39144415685feb050c82 not found: ID does not exist"
Jul 29 01:15:40.022613 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.022571    2557 scope.go:117] "RemoveContainer" containerID="706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"
Jul 29 01:15:40.022832 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.022812    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953"} err="failed to get container status \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": rpc error: code = NotFound desc = could not find container \"706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953\": container with ID starting with 706ae2072ded61fc57cd81319675672173f31bff68b3cdaf397a683efda9d953 not found: ID does not exist"
Jul 29 01:15:40.022899 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.022840    2557 scope.go:117] "RemoveContainer" containerID="dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"
Jul 29 01:15:40.023076 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.023056    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1"} err="failed to get container status \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": rpc error: code = NotFound desc = could not find container \"dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1\": container with ID starting with dc664dcb6c8335175022a7d160a334ffbee66e5f7bc4a57f8b1715401b4355e1 not found: ID does not exist"
Jul 29 01:15:40.112810 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.112768    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.112978 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.112836    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa4ba721-087f-4441-9920-1004989790c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.112978 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.112891    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.112974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-config\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113063    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa4ba721-087f-4441-9920-1004989790c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113103    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113151    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113208    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113233    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113250    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqngr\" (UniqueName: \"kubernetes.io/projected/fa4ba721-087f-4441-9920-1004989790c0-kube-api-access-jqngr\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113308    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113507 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113338    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113507 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113507 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113507 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113414    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113507 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113435    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113501    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113545    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.113684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.113566    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214200 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214155    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214403 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214211    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214403 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214236    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214403 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214331    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214403 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214387    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214439    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214463    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214508    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214581    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa4ba721-087f-4441-9920-1004989790c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214614    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214640    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214672    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-config\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214699    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa4ba721-087f-4441-9920-1004989790c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214728    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214755    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.214807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214835    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214860    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqngr\" (UniqueName: \"kubernetes.io/projected/fa4ba721-087f-4441-9920-1004989790c0-kube-api-access-jqngr\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214896    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.214938    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215116 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.215005    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215407 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.215176    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.215407 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.215331    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.216348 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.215914    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.216348 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.215952    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.217211    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.217378    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.217683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.218152    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.218310    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa4ba721-087f-4441-9920-1004989790c0-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.218366    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa4ba721-087f-4441-9920-1004989790c0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.218570    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.218750    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220590 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.220518    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220590 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.220530    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220590 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.220571    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220590 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.220584    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-config\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.220725 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.220584    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa4ba721-087f-4441-9920-1004989790c0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.223580 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.223548    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa4ba721-087f-4441-9920-1004989790c0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.225395 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.225361    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqngr\" (UniqueName: \"kubernetes.io/projected/fa4ba721-087f-4441-9920-1004989790c0-kube-api-access-jqngr\") pod \"prometheus-k8s-0\" (UID: \"fa4ba721-087f-4441-9920-1004989790c0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.315401 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.315332    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:40.473759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.473715    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:40.477864 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:15:40.477834    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4ba721_087f_4441_9920_1004989790c0.slice/crio-59c56ff080ad16f5e157b65a9cfddc83a0eda142247eb92bc37f20dbe70ecd8f WatchSource:0}: Error finding container 59c56ff080ad16f5e157b65a9cfddc83a0eda142247eb92bc37f20dbe70ecd8f: Status 404 returned error can't find the container with id 59c56ff080ad16f5e157b65a9cfddc83a0eda142247eb92bc37f20dbe70ecd8f
Jul 29 01:15:40.950064 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.950024    2557 generic.go:356] "Generic (PLEG): container finished" podID="fa4ba721-087f-4441-9920-1004989790c0" containerID="d587c822bb4ce7957aa23373935c7d1e2ac83b4122f0d0f2e0276af324b6309a" exitCode=0
Jul 29 01:15:40.950576 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.950067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerDied","Data":"d587c822bb4ce7957aa23373935c7d1e2ac83b4122f0d0f2e0276af324b6309a"}
Jul 29 01:15:40.950576 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:40.950157    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"59c56ff080ad16f5e157b65a9cfddc83a0eda142247eb92bc37f20dbe70ecd8f"}
Jul 29 01:15:41.425775 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.425733    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:15:41.428596 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.428557    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e6d744d-8d4e-4697-89a2-7b343e495e0d-metrics-certs\") pod \"network-metrics-daemon-rdb8t\" (UID: \"3e6d744d-8d4e-4697-89a2-7b343e495e0d\") " pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:15:41.520210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.520121    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p2784\""
Jul 29 01:15:41.523708 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.523668    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="342d95ad-8a8e-4afb-a1ad-36014cb03677" path="/var/lib/kubelet/pods/342d95ad-8a8e-4afb-a1ad-36014cb03677/volumes"
Jul 29 01:15:41.528421 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.528394    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rdb8t"
Jul 29 01:15:41.674004 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.673960    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rdb8t"]
Jul 29 01:15:41.677377 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:15:41.677337    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6d744d_8d4e_4697_89a2_7b343e495e0d.slice/crio-fc747d7ad680c61f007c9ede88dbe441f751759e79f578b3c67c0c020fa5930e WatchSource:0}: Error finding container fc747d7ad680c61f007c9ede88dbe441f751759e79f578b3c67c0c020fa5930e: Status 404 returned error can't find the container with id fc747d7ad680c61f007c9ede88dbe441f751759e79f578b3c67c0c020fa5930e
Jul 29 01:15:41.679837 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.679812    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:15:41.959036 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.958997    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rdb8t" event={"ID":"3e6d744d-8d4e-4697-89a2-7b343e495e0d","Type":"ContainerStarted","Data":"fc747d7ad680c61f007c9ede88dbe441f751759e79f578b3c67c0c020fa5930e"}
Jul 29 01:15:41.962928 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.962886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"d9b11a008593d4ba5e30a6fbbd68972cbfdacd27a57ace19b502fd8c92b0467f"}
Jul 29 01:15:41.963070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.962958    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"6d65ec73d47191aad34a211156b179d9799012676ee9a19ff434d4ba6dbcf57d"}
Jul 29 01:15:41.963070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.962987    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"96e8bd71e1c79f9d7af1c339df7a4fae8536ea232a8b62073a9384380e459fcd"}
Jul 29 01:15:41.963070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.963012    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"8146bc48763559d2e609b589e830a8df13a3d3783af7d6460d24dac028279c08"}
Jul 29 01:15:41.963070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.963035    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"907a1b454b12d762c132efbb309246b5d5930f85529be905313e8c3839c3d5e7"}
Jul 29 01:15:41.963070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.963059    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa4ba721-087f-4441-9920-1004989790c0","Type":"ContainerStarted","Data":"06493d7a2d77e15f5fa987d0c3e0583fe7a9410c03d43cfa2a6ab8fd0280b472"}
Jul 29 01:15:41.989870 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:41.989800    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.963855781 podStartE2EDuration="2.989776168s" totalImagesPullingTime="0s" totalInitContainerRuntime="25.920387ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:41.988807687 +0000 UTC m=+374.980773367" watchObservedRunningTime="2026-07-29 01:15:41.989776168 +0000 UTC m=+374.981741877"
Jul 29 01:15:42.970661 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:42.970609    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rdb8t" event={"ID":"3e6d744d-8d4e-4697-89a2-7b343e495e0d","Type":"ContainerStarted","Data":"c3a35f1b29288e4a21e8c8b7e72bcfbd2cb5997f6c9dc97a067a94cbbb7a2fc2"}
Jul 29 01:15:42.971192 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:42.970687    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rdb8t" event={"ID":"3e6d744d-8d4e-4697-89a2-7b343e495e0d","Type":"ContainerStarted","Data":"b935faab27702e7a336dee3f27660057b76ac262c9f4466d7f039b8023bd842f"}
Jul 29 01:15:42.987118 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:42.987055    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rdb8t" podStartSLOduration=375.151497653 podStartE2EDuration="6m15.987034939s" totalImagesPullingTime="835.537286ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:42.98617472 +0000 UTC m=+375.978140390" watchObservedRunningTime="2026-07-29 01:15:42.987034939 +0000 UTC m=+375.979000606"
Jul 29 01:15:45.316177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:15:45.316113    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:40.316328 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:16:40.316289    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:40.332544 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:16:40.332513    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:41.224990 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:16:41.224962    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:17:25.925408 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.925327    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"]
Jul 29 01:17:25.927841 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.927822    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:25.930384 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.930362    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:17:25.930663 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.930645    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:17:25.930926 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.930913    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:17:25.931393 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.931373    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:17:25.931492 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.931475    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vl6gp\""
Jul 29 01:17:25.948367 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:25.948343    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"]
Jul 29 01:17:26.028924 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.028893    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.029094 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.028943    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.029094 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.029021    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwnhc\" (UniqueName: \"kubernetes.io/projected/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-kube-api-access-hwnhc\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.029094 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.029085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.029223 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.029109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.130386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.130349    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwnhc\" (UniqueName: \"kubernetes.io/projected/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-kube-api-access-hwnhc\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.130620 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.130399    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.130620 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.130422    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.130620 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.130464    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.130620 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.130502    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.130957 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.130934    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-manifests\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.132746 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.132726    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-tmp\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.132892 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.132873    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-webhook-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.132952 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.132931    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.138611 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.138590    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwnhc\" (UniqueName: \"kubernetes.io/projected/ffd9ce56-2f99-4635-bf6b-acef7ba8e939-kube-api-access-hwnhc\") pod \"opendatahub-operator-controller-manager-d5ff8d77b-mgsnm\" (UID: \"ffd9ce56-2f99-4635-bf6b-acef7ba8e939\") " pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.238317 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.238225    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:26.367743 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.367710    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"]
Jul 29 01:17:26.372139 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:17:26.372111    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd9ce56_2f99_4635_bf6b_acef7ba8e939.slice/crio-75d204d907d6020e75cdd909cd0200b83179b2183f96395e97c43cb39f6ae81b WatchSource:0}: Error finding container 75d204d907d6020e75cdd909cd0200b83179b2183f96395e97c43cb39f6ae81b: Status 404 returned error can't find the container with id 75d204d907d6020e75cdd909cd0200b83179b2183f96395e97c43cb39f6ae81b
Jul 29 01:17:26.382078 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:26.382052    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm" event={"ID":"ffd9ce56-2f99-4635-bf6b-acef7ba8e939","Type":"ContainerStarted","Data":"75d204d907d6020e75cdd909cd0200b83179b2183f96395e97c43cb39f6ae81b"}
Jul 29 01:17:29.397092 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:29.397060    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm" event={"ID":"ffd9ce56-2f99-4635-bf6b-acef7ba8e939","Type":"ContainerStarted","Data":"41a97c48f971b723d89885c48a002e1bb4b69e85d89a922d9880f5872fa0f26d"}
Jul 29 01:17:31.406443 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:31.406410    2557 generic.go:356] "Generic (PLEG): container finished" podID="ffd9ce56-2f99-4635-bf6b-acef7ba8e939" containerID="41a97c48f971b723d89885c48a002e1bb4b69e85d89a922d9880f5872fa0f26d" exitCode=0
Jul 29 01:17:31.406845 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:31.406480    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm" event={"ID":"ffd9ce56-2f99-4635-bf6b-acef7ba8e939","Type":"ContainerDied","Data":"41a97c48f971b723d89885c48a002e1bb4b69e85d89a922d9880f5872fa0f26d"}
Jul 29 01:17:32.412654 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:32.412614    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm" event={"ID":"ffd9ce56-2f99-4635-bf6b-acef7ba8e939","Type":"ContainerStarted","Data":"7ed58b72fb528a985fe592bf1477287404ae431fdee8be6f54a738dc8468e387"}
Jul 29 01:17:32.413055 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:32.412918    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:32.436715 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:32.436654    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm" podStartSLOduration=2.995389669 podStartE2EDuration="7.436634537s" totalImagesPullingTime="3.378492894s" totalInitContainerRuntime="1.062751974s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:32.434533894 +0000 UTC m=+485.426499561" watchObservedRunningTime="2026-07-29 01:17:32.436634537 +0000 UTC m=+485.428600211"
Jul 29 01:17:43.418899 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:43.418860    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d5ff8d77b-mgsnm"
Jul 29 01:17:46.036532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.036484    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"]
Jul 29 01:17:46.050274 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.050240    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.054175 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.054149    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r22pc\""
Jul 29 01:17:46.054458 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.054435    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 01:17:46.054720 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.054692    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 01:17:46.055081 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.055056    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"]
Jul 29 01:17:46.084835 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.084803    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tls-certs\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.084835 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.084834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l28j\" (UniqueName: \"kubernetes.io/projected/bee1fcdf-50fc-448c-aeb1-a06d507bc671-kube-api-access-8l28j\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.085007 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.084861    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tmp\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.185446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.185414    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tls-certs\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.185446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.185451    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l28j\" (UniqueName: \"kubernetes.io/projected/bee1fcdf-50fc-448c-aeb1-a06d507bc671-kube-api-access-8l28j\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.185653 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.185481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tmp\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.185653 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:17:46.185555    2557 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 29 01:17:46.185653 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:17:46.185634    2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tls-certs podName:bee1fcdf-50fc-448c-aeb1-a06d507bc671 nodeName:}" failed. No retries permitted until 2026-07-29 01:17:46.685615868 +0000 UTC m=+499.677581517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tls-certs") pod "kube-auth-proxy-7f844789c7-x8x6h" (UID: "bee1fcdf-50fc-448c-aeb1-a06d507bc671") : secret "kube-auth-proxy-tls" not found
Jul 29 01:17:46.187641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.187616    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tmp\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.204856 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.204823    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l28j\" (UniqueName: \"kubernetes.io/projected/bee1fcdf-50fc-448c-aeb1-a06d507bc671-kube-api-access-8l28j\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.689819 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.689762    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tls-certs\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.692133 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.692108    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bee1fcdf-50fc-448c-aeb1-a06d507bc671-tls-certs\") pod \"kube-auth-proxy-7f844789c7-x8x6h\" (UID: \"bee1fcdf-50fc-448c-aeb1-a06d507bc671\") " pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:46.961442 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:46.961360    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"
Jul 29 01:17:47.127570 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:47.127536    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h"]
Jul 29 01:17:47.130834 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:17:47.130802    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbee1fcdf_50fc_448c_aeb1_a06d507bc671.slice/crio-86f78a14d581c66f4499ed89a87e95696304c15cd6d1a96b18148d16e7f5cf3c WatchSource:0}: Error finding container 86f78a14d581c66f4499ed89a87e95696304c15cd6d1a96b18148d16e7f5cf3c: Status 404 returned error can't find the container with id 86f78a14d581c66f4499ed89a87e95696304c15cd6d1a96b18148d16e7f5cf3c
Jul 29 01:17:47.483459 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:47.483419    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h" event={"ID":"bee1fcdf-50fc-448c-aeb1-a06d507bc671","Type":"ContainerStarted","Data":"86f78a14d581c66f4499ed89a87e95696304c15cd6d1a96b18148d16e7f5cf3c"}
Jul 29 01:17:50.498503 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:50.498465    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h" event={"ID":"bee1fcdf-50fc-448c-aeb1-a06d507bc671","Type":"ContainerStarted","Data":"a070d4aeeeeab5b6ed84e38a25c67b799172e4ec5c3459cf0674efdbac481111"}
Jul 29 01:17:50.516524 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:50.516467    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f844789c7-x8x6h" podStartSLOduration=1.986017317 podStartE2EDuration="4.516451898s" totalImagesPullingTime="2.530434581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:50.514914323 +0000 UTC m=+503.506879992" watchObservedRunningTime="2026-07-29 01:17:50.516451898 +0000 UTC m=+503.508417566"
Jul 29 01:17:53.571550 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.571511    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"]
Jul 29 01:17:53.575814 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.575787    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.580974 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.580947    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 01:17:53.588673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.588653    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 01:17:53.588673 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.588666    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:17:53.588840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.588666    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 01:17:53.588840 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.588695    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 01:17:53.588947 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.588934    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-95ltp\""
Jul 29 01:17:53.594077 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.594051    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"]
Jul 29 01:17:53.651143 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.651109    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dc9338d-2383-4670-a8a6-2f1d119127f9-metrics-cert\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.651337 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.651173    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc9338d-2383-4670-a8a6-2f1d119127f9-cert\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.651337 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.651200    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggffj\" (UniqueName: \"kubernetes.io/projected/4dc9338d-2383-4670-a8a6-2f1d119127f9-kube-api-access-ggffj\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.651337 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.651222    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dc9338d-2383-4670-a8a6-2f1d119127f9-manager-config\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.752023 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.751984    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dc9338d-2383-4670-a8a6-2f1d119127f9-metrics-cert\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.752174 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.752054    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc9338d-2383-4670-a8a6-2f1d119127f9-cert\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.752174 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.752089    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggffj\" (UniqueName: \"kubernetes.io/projected/4dc9338d-2383-4670-a8a6-2f1d119127f9-kube-api-access-ggffj\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.752174 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.752119    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dc9338d-2383-4670-a8a6-2f1d119127f9-manager-config\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.752994 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.752968    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4dc9338d-2383-4670-a8a6-2f1d119127f9-manager-config\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.754717 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.754688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4dc9338d-2383-4670-a8a6-2f1d119127f9-cert\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.754828 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.754688    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4dc9338d-2383-4670-a8a6-2f1d119127f9-metrics-cert\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.766172 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.766140    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggffj\" (UniqueName: \"kubernetes.io/projected/4dc9338d-2383-4670-a8a6-2f1d119127f9-kube-api-access-ggffj\") pod \"lws-controller-manager-588fcb66d4-vx5jx\" (UID: \"4dc9338d-2383-4670-a8a6-2f1d119127f9\") " pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:53.885000 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:53.884956    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:54.030204 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:54.030133    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"]
Jul 29 01:17:54.032624 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:17:54.032586    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc9338d_2383_4670_a8a6_2f1d119127f9.slice/crio-b13bb75afd9efe3628dff91a15365ab7a40cb54f0faf13b034b06d5f1884b4c2 WatchSource:0}: Error finding container b13bb75afd9efe3628dff91a15365ab7a40cb54f0faf13b034b06d5f1884b4c2: Status 404 returned error can't find the container with id b13bb75afd9efe3628dff91a15365ab7a40cb54f0faf13b034b06d5f1884b4c2
Jul 29 01:17:54.516704 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:54.516668    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx" event={"ID":"4dc9338d-2383-4670-a8a6-2f1d119127f9","Type":"ContainerStarted","Data":"b13bb75afd9efe3628dff91a15365ab7a40cb54f0faf13b034b06d5f1884b4c2"}
Jul 29 01:17:57.531712 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:57.531675    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx" event={"ID":"4dc9338d-2383-4670-a8a6-2f1d119127f9","Type":"ContainerStarted","Data":"3fc1612c8d882956d2a13b52a17b4bc7c4b868264b6cdd0b8690df796e88b092"}
Jul 29 01:17:57.532105 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:57.531755    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:17:57.582780 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:17:57.582727    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx" podStartSLOduration=1.273223453 podStartE2EDuration="4.582711234s" totalImagesPullingTime="3.309487781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:17:57.582100574 +0000 UTC m=+510.574066242" watchObservedRunningTime="2026-07-29 01:17:57.582711234 +0000 UTC m=+510.574676916"
Jul 29 01:18:08.538922 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:18:08.538890    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-588fcb66d4-vx5jx"
Jul 29 01:20:21.528154 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.528074    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:21.530806 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.530789    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.533299 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.533273    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 29 01:20:21.533422 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.533401    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 01:20:21.533486 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.533467    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l69wn\""
Jul 29 01:20:21.533540 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.533519    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 01:20:21.538272 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.538232    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:21.619762 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.619728    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:21.655104 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.655071    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-config-file\") pod \"limitador-limitador-64c94fd64f-qcvqb\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.655301 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.655112    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfccg\" (UniqueName: \"kubernetes.io/projected/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-kube-api-access-jfccg\") pod \"limitador-limitador-64c94fd64f-qcvqb\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.755976 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.755936    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-config-file\") pod \"limitador-limitador-64c94fd64f-qcvqb\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.756170 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.755981    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfccg\" (UniqueName: \"kubernetes.io/projected/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-kube-api-access-jfccg\") pod \"limitador-limitador-64c94fd64f-qcvqb\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.756595 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.756574    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-config-file\") pod \"limitador-limitador-64c94fd64f-qcvqb\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.763912 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.763889    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfccg\" (UniqueName: \"kubernetes.io/projected/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-kube-api-access-jfccg\") pod \"limitador-limitador-64c94fd64f-qcvqb\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.842142 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.842049    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:21.973669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:21.973642    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:21.975742 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:20:21.975713    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eba2efc_b7e1_4a28_8462_d9fa123f5cb3.slice/crio-8b727a8f27a7eeadc788a2d0d2d74178d97cf3e2eb96f2f3226811e95a27edd5 WatchSource:0}: Error finding container 8b727a8f27a7eeadc788a2d0d2d74178d97cf3e2eb96f2f3226811e95a27edd5: Status 404 returned error can't find the container with id 8b727a8f27a7eeadc788a2d0d2d74178d97cf3e2eb96f2f3226811e95a27edd5
Jul 29 01:20:22.148918 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.148886    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb" event={"ID":"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3","Type":"ContainerStarted","Data":"8b727a8f27a7eeadc788a2d0d2d74178d97cf3e2eb96f2f3226811e95a27edd5"}
Jul 29 01:20:22.440917 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.440835    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8jm2r"]
Jul 29 01:20:22.443528 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.443506    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:22.446077 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.446057    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4dcq\""
Jul 29 01:20:22.451203 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.451183    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8jm2r"]
Jul 29 01:20:22.564280 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.564029    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nffmr\" (UniqueName: \"kubernetes.io/projected/975013f1-1993-4069-8602-c36b6ab959f6-kube-api-access-nffmr\") pod \"authorino-75d556bd77-8jm2r\" (UID: \"975013f1-1993-4069-8602-c36b6ab959f6\") " pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:22.665480 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.665441    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nffmr\" (UniqueName: \"kubernetes.io/projected/975013f1-1993-4069-8602-c36b6ab959f6-kube-api-access-nffmr\") pod \"authorino-75d556bd77-8jm2r\" (UID: \"975013f1-1993-4069-8602-c36b6ab959f6\") " pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:22.688210 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.688173    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nffmr\" (UniqueName: \"kubernetes.io/projected/975013f1-1993-4069-8602-c36b6ab959f6-kube-api-access-nffmr\") pod \"authorino-75d556bd77-8jm2r\" (UID: \"975013f1-1993-4069-8602-c36b6ab959f6\") " pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:22.760585 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.760323    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:22.910231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:22.910185    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8jm2r"]
Jul 29 01:20:22.913407 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:20:22.913373    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod975013f1_1993_4069_8602_c36b6ab959f6.slice/crio-0bc2ac0a0329e5e30a0cfd2add39a447e89c1e5a60abb9b091a5473600914922 WatchSource:0}: Error finding container 0bc2ac0a0329e5e30a0cfd2add39a447e89c1e5a60abb9b091a5473600914922: Status 404 returned error can't find the container with id 0bc2ac0a0329e5e30a0cfd2add39a447e89c1e5a60abb9b091a5473600914922
Jul 29 01:20:23.154052 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:23.154021    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8jm2r" event={"ID":"975013f1-1993-4069-8602-c36b6ab959f6","Type":"ContainerStarted","Data":"0bc2ac0a0329e5e30a0cfd2add39a447e89c1e5a60abb9b091a5473600914922"}
Jul 29 01:20:25.168069 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:25.168032    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb" event={"ID":"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3","Type":"ContainerStarted","Data":"1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f"}
Jul 29 01:20:25.168504 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:25.168182    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:25.186758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:25.186700    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb" podStartSLOduration=1.619935609 podStartE2EDuration="4.186678993s" totalImagesPullingTime="2.566743384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:25.184147461 +0000 UTC m=+658.176113131" watchObservedRunningTime="2026-07-29 01:20:25.186678993 +0000 UTC m=+658.178644663"
Jul 29 01:20:27.178486 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:27.178453    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8jm2r" event={"ID":"975013f1-1993-4069-8602-c36b6ab959f6","Type":"ContainerStarted","Data":"97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4"}
Jul 29 01:20:27.193011 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:27.192953    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8jm2r" podStartSLOduration=1.288465087 podStartE2EDuration="5.19293338s" totalImagesPullingTime="3.904468293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:27.192725575 +0000 UTC m=+660.184691244" watchObservedRunningTime="2026-07-29 01:20:27.19293338 +0000 UTC m=+660.184899053"
Jul 29 01:20:36.174871 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:36.174831    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:38.642219 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:38.642183    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:38.642664 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:38.642384    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb" podUID="9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" containerName="limitador" containerID="cri-o://1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f" gracePeriod=30
Jul 29 01:20:39.177752 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.177727    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:39.230371 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230296    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfccg\" (UniqueName: \"kubernetes.io/projected/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-kube-api-access-jfccg\") pod \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") "
Jul 29 01:20:39.230371 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230356    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-config-file\") pod \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\" (UID: \"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3\") "
Jul 29 01:20:39.230769 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230744    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-config-file" (OuterVolumeSpecName: "config-file") pod "9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" (UID: "9eba2efc-b7e1-4a28-8462-d9fa123f5cb3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:20:39.230881 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230859    2557 generic.go:356] "Generic (PLEG): container finished" podID="9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" containerID="1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f" exitCode=0
Jul 29 01:20:39.230921 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230902    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"
Jul 29 01:20:39.230955 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230908    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb" event={"ID":"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3","Type":"ContainerDied","Data":"1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f"}
Jul 29 01:20:39.230996 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.230977    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qcvqb" event={"ID":"9eba2efc-b7e1-4a28-8462-d9fa123f5cb3","Type":"ContainerDied","Data":"8b727a8f27a7eeadc788a2d0d2d74178d97cf3e2eb96f2f3226811e95a27edd5"}
Jul 29 01:20:39.231033 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.231010    2557 scope.go:117] "RemoveContainer" containerID="1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f"
Jul 29 01:20:39.232689 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.232667    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-kube-api-access-jfccg" (OuterVolumeSpecName: "kube-api-access-jfccg") pod "9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" (UID: "9eba2efc-b7e1-4a28-8462-d9fa123f5cb3"). InnerVolumeSpecName "kube-api-access-jfccg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:39.242364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.242345    2557 scope.go:117] "RemoveContainer" containerID="1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f"
Jul 29 01:20:39.242617 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:20:39.242600    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f\": container with ID starting with 1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f not found: ID does not exist" containerID="1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f"
Jul 29 01:20:39.242676 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.242629    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f"} err="failed to get container status \"1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f\": rpc error: code = NotFound desc = could not find container \"1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f\": container with ID starting with 1001dae41dc0b96a0696fdd217f3a2a66baec4c88fa354a4e068634ad625730f not found: ID does not exist"
Jul 29 01:20:39.331637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.331591    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfccg\" (UniqueName: \"kubernetes.io/projected/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-kube-api-access-jfccg\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:20:39.331637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.331636    2557 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3-config-file\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:20:39.549875 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.549845    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:39.555389 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:39.555349    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qcvqb"]
Jul 29 01:20:41.522575 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:41.522539    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" path="/var/lib/kubelet/pods/9eba2efc-b7e1-4a28-8462-d9fa123f5cb3/volumes"
Jul 29 01:20:43.330738 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.330698    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"]
Jul 29 01:20:43.331201 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.331186    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" containerName="limitador"
Jul 29 01:20:43.331293 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.331205    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" containerName="limitador"
Jul 29 01:20:43.331362 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.331314    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eba2efc-b7e1-4a28-8462-d9fa123f5cb3" containerName="limitador"
Jul 29 01:20:43.334104 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.334084    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.345491 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.345472    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 29 01:20:43.346690 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.346674    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:20:43.346782 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.346716    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-27z2d\""
Jul 29 01:20:43.346782 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.346674    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:20:43.365122 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.365098    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45gs7\" (UniqueName: \"kubernetes.io/projected/2cf7590d-c5f9-42a2-ac31-0f88f10c1445-kube-api-access-45gs7\") pod \"postgres-69fb4594cf-r65rc\" (UID: \"2cf7590d-c5f9-42a2-ac31-0f88f10c1445\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.365226 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.365135    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2cf7590d-c5f9-42a2-ac31-0f88f10c1445-data\") pod \"postgres-69fb4594cf-r65rc\" (UID: \"2cf7590d-c5f9-42a2-ac31-0f88f10c1445\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.414893 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.414863    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"]
Jul 29 01:20:43.466602 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.466569    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45gs7\" (UniqueName: \"kubernetes.io/projected/2cf7590d-c5f9-42a2-ac31-0f88f10c1445-kube-api-access-45gs7\") pod \"postgres-69fb4594cf-r65rc\" (UID: \"2cf7590d-c5f9-42a2-ac31-0f88f10c1445\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.466602 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.466606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2cf7590d-c5f9-42a2-ac31-0f88f10c1445-data\") pod \"postgres-69fb4594cf-r65rc\" (UID: \"2cf7590d-c5f9-42a2-ac31-0f88f10c1445\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.466927 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.466912    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2cf7590d-c5f9-42a2-ac31-0f88f10c1445-data\") pod \"postgres-69fb4594cf-r65rc\" (UID: \"2cf7590d-c5f9-42a2-ac31-0f88f10c1445\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.496165 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.496133    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45gs7\" (UniqueName: \"kubernetes.io/projected/2cf7590d-c5f9-42a2-ac31-0f88f10c1445-kube-api-access-45gs7\") pod \"postgres-69fb4594cf-r65rc\" (UID: \"2cf7590d-c5f9-42a2-ac31-0f88f10c1445\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.643587 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.643554    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:43.768793 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.768769    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"]
Jul 29 01:20:43.770954 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:20:43.770918    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf7590d_c5f9_42a2_ac31_0f88f10c1445.slice/crio-5f59b7507aefe890ceae817d59312dcfe5e9037379474f5e3e2aca36e026929b WatchSource:0}: Error finding container 5f59b7507aefe890ceae817d59312dcfe5e9037379474f5e3e2aca36e026929b: Status 404 returned error can't find the container with id 5f59b7507aefe890ceae817d59312dcfe5e9037379474f5e3e2aca36e026929b
Jul 29 01:20:43.772472 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:43.772450    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:20:44.252725 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:44.252688    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc" event={"ID":"2cf7590d-c5f9-42a2-ac31-0f88f10c1445","Type":"ContainerStarted","Data":"5f59b7507aefe890ceae817d59312dcfe5e9037379474f5e3e2aca36e026929b"}
Jul 29 01:20:49.278188 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:49.278145    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc" event={"ID":"2cf7590d-c5f9-42a2-ac31-0f88f10c1445","Type":"ContainerStarted","Data":"0584837c8c684427b1156939e6b94264d8353cd37082222e816e29a1b5f775ca"}
Jul 29 01:20:49.278580 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:49.278219    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:49.295358 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:49.295309    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc" podStartSLOduration=1.402118832 podStartE2EDuration="6.295295829s" totalImagesPullingTime="4.893176997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:49.294514438 +0000 UTC m=+682.286480105" watchObservedRunningTime="2026-07-29 01:20:49.295295829 +0000 UTC m=+682.287261496"
Jul 29 01:20:55.309589 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:55.309554    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-r65rc"
Jul 29 01:20:56.145849 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.145816    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8cbf96dc7-f8242"]
Jul 29 01:20:56.149777 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.149758    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.152276 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.152240    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 29 01:20:56.157080 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.157059    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8cbf96dc7-f8242"]
Jul 29 01:20:56.286845 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.286806    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697a0517-2cee-4719-907c-eb481481925b-tls-cert\") pod \"authorino-8cbf96dc7-f8242\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") " pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.287020 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.286871    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7xkz\" (UniqueName: \"kubernetes.io/projected/697a0517-2cee-4719-907c-eb481481925b-kube-api-access-f7xkz\") pod \"authorino-8cbf96dc7-f8242\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") " pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.388048 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.388007    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7xkz\" (UniqueName: \"kubernetes.io/projected/697a0517-2cee-4719-907c-eb481481925b-kube-api-access-f7xkz\") pod \"authorino-8cbf96dc7-f8242\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") " pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.388445 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.388087    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697a0517-2cee-4719-907c-eb481481925b-tls-cert\") pod \"authorino-8cbf96dc7-f8242\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") " pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.390627 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.390603    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697a0517-2cee-4719-907c-eb481481925b-tls-cert\") pod \"authorino-8cbf96dc7-f8242\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") " pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.395641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.395618    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7xkz\" (UniqueName: \"kubernetes.io/projected/697a0517-2cee-4719-907c-eb481481925b-kube-api-access-f7xkz\") pod \"authorino-8cbf96dc7-f8242\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") " pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.459655 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.459577    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:20:56.587708 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:56.587652    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8cbf96dc7-f8242"]
Jul 29 01:20:56.589864 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:20:56.589840    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod697a0517_2cee_4719_907c_eb481481925b.slice/crio-4ed98c5f52b6bfdb572662d5a1de8f4100d17d62e27711ccb957a82fc319fa53 WatchSource:0}: Error finding container 4ed98c5f52b6bfdb572662d5a1de8f4100d17d62e27711ccb957a82fc319fa53: Status 404 returned error can't find the container with id 4ed98c5f52b6bfdb572662d5a1de8f4100d17d62e27711ccb957a82fc319fa53
Jul 29 01:20:57.315204 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.315110    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8cbf96dc7-f8242" event={"ID":"697a0517-2cee-4719-907c-eb481481925b","Type":"ContainerStarted","Data":"8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509"}
Jul 29 01:20:57.315204 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.315158    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8cbf96dc7-f8242" event={"ID":"697a0517-2cee-4719-907c-eb481481925b","Type":"ContainerStarted","Data":"4ed98c5f52b6bfdb572662d5a1de8f4100d17d62e27711ccb957a82fc319fa53"}
Jul 29 01:20:57.331574 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.331527    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8cbf96dc7-f8242" podStartSLOduration=0.915538651 podStartE2EDuration="1.331512778s" totalImagesPullingTime="415.974127ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:57.330340512 +0000 UTC m=+690.322306179" watchObservedRunningTime="2026-07-29 01:20:57.331512778 +0000 UTC m=+690.323478446"
Jul 29 01:20:57.356103 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.356068    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8jm2r"]
Jul 29 01:20:57.356281 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.356248    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8jm2r" podUID="975013f1-1993-4069-8602-c36b6ab959f6" containerName="authorino" containerID="cri-o://97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4" gracePeriod=30
Jul 29 01:20:57.611635 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.611613    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:57.700089 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.700058    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nffmr\" (UniqueName: \"kubernetes.io/projected/975013f1-1993-4069-8602-c36b6ab959f6-kube-api-access-nffmr\") pod \"975013f1-1993-4069-8602-c36b6ab959f6\" (UID: \"975013f1-1993-4069-8602-c36b6ab959f6\") "
Jul 29 01:20:57.701975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.701948    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/975013f1-1993-4069-8602-c36b6ab959f6-kube-api-access-nffmr" (OuterVolumeSpecName: "kube-api-access-nffmr") pod "975013f1-1993-4069-8602-c36b6ab959f6" (UID: "975013f1-1993-4069-8602-c36b6ab959f6"). InnerVolumeSpecName "kube-api-access-nffmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:20:57.801186 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:57.801152    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nffmr\" (UniqueName: \"kubernetes.io/projected/975013f1-1993-4069-8602-c36b6ab959f6-kube-api-access-nffmr\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:20:58.320613 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.320574    2557 generic.go:356] "Generic (PLEG): container finished" podID="975013f1-1993-4069-8602-c36b6ab959f6" containerID="97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4" exitCode=0
Jul 29 01:20:58.320776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.320632    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8jm2r"
Jul 29 01:20:58.320776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.320663    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8jm2r" event={"ID":"975013f1-1993-4069-8602-c36b6ab959f6","Type":"ContainerDied","Data":"97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4"}
Jul 29 01:20:58.320776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.320706    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8jm2r" event={"ID":"975013f1-1993-4069-8602-c36b6ab959f6","Type":"ContainerDied","Data":"0bc2ac0a0329e5e30a0cfd2add39a447e89c1e5a60abb9b091a5473600914922"}
Jul 29 01:20:58.320776 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.320727    2557 scope.go:117] "RemoveContainer" containerID="97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4"
Jul 29 01:20:58.329029 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.329013    2557 scope.go:117] "RemoveContainer" containerID="97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4"
Jul 29 01:20:58.329323 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:20:58.329299    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4\": container with ID starting with 97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4 not found: ID does not exist" containerID="97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4"
Jul 29 01:20:58.329378 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.329335    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4"} err="failed to get container status \"97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4\": rpc error: code = NotFound desc = could not find container \"97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4\": container with ID starting with 97fbb784b5bd845736cf1431c8ea2b7e5795cfe56bd9b6839d9366d679548eb4 not found: ID does not exist"
Jul 29 01:20:58.340097 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.340073    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8jm2r"]
Jul 29 01:20:58.342332 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:58.342313    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8jm2r"]
Jul 29 01:20:59.521821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:20:59.521786    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="975013f1-1993-4069-8602-c36b6ab959f6" path="/var/lib/kubelet/pods/975013f1-1993-4069-8602-c36b6ab959f6/volumes"
Jul 29 01:21:02.093376 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.093346    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-597f78b47f-x8tpn"]
Jul 29 01:21:02.093738 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.093694    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="975013f1-1993-4069-8602-c36b6ab959f6" containerName="authorino"
Jul 29 01:21:02.093738 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.093705    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="975013f1-1993-4069-8602-c36b6ab959f6" containerName="authorino"
Jul 29 01:21:02.093807 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.093773    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="975013f1-1993-4069-8602-c36b6ab959f6" containerName="authorino"
Jul 29 01:21:02.295618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.295586    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-597f78b47f-x8tpn"]
Jul 29 01:21:02.295780 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.295719    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.298802 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.298783    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:21:02.299420 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.299405    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-pqq85\""
Jul 29 01:21:02.299802 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.299784    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:21:02.447686 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.447649    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f920842-7931-4a8f-9851-f969b3f3443a-webhook-cert\") pod \"maas-controller-597f78b47f-x8tpn\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") " pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.447859 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.447790    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnl8q\" (UniqueName: \"kubernetes.io/projected/6f920842-7931-4a8f-9851-f969b3f3443a-kube-api-access-mnl8q\") pod \"maas-controller-597f78b47f-x8tpn\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") " pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.548969 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.548934    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnl8q\" (UniqueName: \"kubernetes.io/projected/6f920842-7931-4a8f-9851-f969b3f3443a-kube-api-access-mnl8q\") pod \"maas-controller-597f78b47f-x8tpn\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") " pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.549153 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.548988    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f920842-7931-4a8f-9851-f969b3f3443a-webhook-cert\") pod \"maas-controller-597f78b47f-x8tpn\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") " pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.551464 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.551439    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f920842-7931-4a8f-9851-f969b3f3443a-webhook-cert\") pod \"maas-controller-597f78b47f-x8tpn\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") " pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.557283 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.557233    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnl8q\" (UniqueName: \"kubernetes.io/projected/6f920842-7931-4a8f-9851-f969b3f3443a-kube-api-access-mnl8q\") pod \"maas-controller-597f78b47f-x8tpn\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") " pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.605905 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.605874    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:02.753245 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:02.753207    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-597f78b47f-x8tpn"]
Jul 29 01:21:02.754650 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:21:02.754623    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f920842_7931_4a8f_9851_f969b3f3443a.slice/crio-88bc72a6b65ba245b569cfbc0a7ad4c1a75f023fe36158e9d929aa59f776d90a WatchSource:0}: Error finding container 88bc72a6b65ba245b569cfbc0a7ad4c1a75f023fe36158e9d929aa59f776d90a: Status 404 returned error can't find the container with id 88bc72a6b65ba245b569cfbc0a7ad4c1a75f023fe36158e9d929aa59f776d90a
Jul 29 01:21:03.346282 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:03.346230    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597f78b47f-x8tpn" event={"ID":"6f920842-7931-4a8f-9851-f969b3f3443a","Type":"ContainerStarted","Data":"88bc72a6b65ba245b569cfbc0a7ad4c1a75f023fe36158e9d929aa59f776d90a"}
Jul 29 01:21:05.357570 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:05.357539    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597f78b47f-x8tpn" event={"ID":"6f920842-7931-4a8f-9851-f969b3f3443a","Type":"ContainerStarted","Data":"eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083"}
Jul 29 01:21:05.357989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:05.357660    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:05.374975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:05.374931    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-597f78b47f-x8tpn" podStartSLOduration=1.165244703 podStartE2EDuration="3.374916718s" totalImagesPullingTime="2.209672015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:05.374219614 +0000 UTC m=+698.366185296" watchObservedRunningTime="2026-07-29 01:21:05.374916718 +0000 UTC m=+698.366882390"
Jul 29 01:21:16.365083 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:16.365047    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:16.826631 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:16.826551    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-597f78b47f-x8tpn"]
Jul 29 01:21:16.826783 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:16.826726    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-597f78b47f-x8tpn" podUID="6f920842-7931-4a8f-9851-f969b3f3443a" containerName="manager" containerID="cri-o://eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083" gracePeriod=30
Jul 29 01:21:17.065612 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.065585    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:17.078030 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.077969    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnl8q\" (UniqueName: \"kubernetes.io/projected/6f920842-7931-4a8f-9851-f969b3f3443a-kube-api-access-mnl8q\") pod \"6f920842-7931-4a8f-9851-f969b3f3443a\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") "
Jul 29 01:21:17.078155 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.078044    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f920842-7931-4a8f-9851-f969b3f3443a-webhook-cert\") pod \"6f920842-7931-4a8f-9851-f969b3f3443a\" (UID: \"6f920842-7931-4a8f-9851-f969b3f3443a\") "
Jul 29 01:21:17.080023 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.079994    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f920842-7931-4a8f-9851-f969b3f3443a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6f920842-7931-4a8f-9851-f969b3f3443a" (UID: "6f920842-7931-4a8f-9851-f969b3f3443a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:21:17.080119 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.080081    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f920842-7931-4a8f-9851-f969b3f3443a-kube-api-access-mnl8q" (OuterVolumeSpecName: "kube-api-access-mnl8q") pod "6f920842-7931-4a8f-9851-f969b3f3443a" (UID: "6f920842-7931-4a8f-9851-f969b3f3443a"). InnerVolumeSpecName "kube-api-access-mnl8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:21:17.178773 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.178737    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnl8q\" (UniqueName: \"kubernetes.io/projected/6f920842-7931-4a8f-9851-f969b3f3443a-kube-api-access-mnl8q\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:21:17.178773 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.178767    2557 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6f920842-7931-4a8f-9851-f969b3f3443a-webhook-cert\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:21:17.418772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.418736    2557 generic.go:356] "Generic (PLEG): container finished" podID="6f920842-7931-4a8f-9851-f969b3f3443a" containerID="eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083" exitCode=0
Jul 29 01:21:17.419231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.418778    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597f78b47f-x8tpn"
Jul 29 01:21:17.419231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.418814    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597f78b47f-x8tpn" event={"ID":"6f920842-7931-4a8f-9851-f969b3f3443a","Type":"ContainerDied","Data":"eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083"}
Jul 29 01:21:17.419231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.418866    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597f78b47f-x8tpn" event={"ID":"6f920842-7931-4a8f-9851-f969b3f3443a","Type":"ContainerDied","Data":"88bc72a6b65ba245b569cfbc0a7ad4c1a75f023fe36158e9d929aa59f776d90a"}
Jul 29 01:21:17.419231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.418893    2557 scope.go:117] "RemoveContainer" containerID="eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083"
Jul 29 01:21:17.428775 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.428759    2557 scope.go:117] "RemoveContainer" containerID="eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083"
Jul 29 01:21:17.429038 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:21:17.429019    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083\": container with ID starting with eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083 not found: ID does not exist" containerID="eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083"
Jul 29 01:21:17.429113 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.429050    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083"} err="failed to get container status \"eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083\": rpc error: code = NotFound desc = could not find container \"eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083\": container with ID starting with eed5d68a13761185fd9f3de739eea2109f53c8d70122263b39eaf05dec327083 not found: ID does not exist"
Jul 29 01:21:17.441733 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.441704    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-597f78b47f-x8tpn"]
Jul 29 01:21:17.448817 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.444242    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-597f78b47f-x8tpn"]
Jul 29 01:21:17.521688 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:17.521655    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f920842-7931-4a8f-9851-f969b3f3443a" path="/var/lib/kubelet/pods/6f920842-7931-4a8f-9851-f969b3f3443a/volumes"
Jul 29 01:21:38.902042 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.902007    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"]
Jul 29 01:21:38.902549 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.902372    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f920842-7931-4a8f-9851-f969b3f3443a" containerName="manager"
Jul 29 01:21:38.902549 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.902384    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f920842-7931-4a8f-9851-f969b3f3443a" containerName="manager"
Jul 29 01:21:38.902549 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.902454    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f920842-7931-4a8f-9851-f969b3f3443a" containerName="manager"
Jul 29 01:21:38.905838 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.905821    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:38.908750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.908726    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5fgbr\""
Jul 29 01:21:38.908883 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.908863    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 01:21:38.918314 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.918290    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"]
Jul 29 01:21:38.928669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.928644    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-7rcs8"]
Jul 29 01:21:38.931127 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.931110    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:38.940940 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.940918    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-7rcs8"]
Jul 29 01:21:38.966937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.966904    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r4p4\" (UniqueName: \"kubernetes.io/projected/f1344ba6-29ab-465d-bff0-294dda5c3c9b-kube-api-access-8r4p4\") pod \"payload-pre-processing-687dbb6cf6-gj62g\" (UID: \"f1344ba6-29ab-465d-bff0-294dda5c3c9b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:38.967091 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:38.966953    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1344ba6-29ab-465d-bff0-294dda5c3c9b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gj62g\" (UID: \"f1344ba6-29ab-465d-bff0-294dda5c3c9b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:39.068250 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.068214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r4p4\" (UniqueName: \"kubernetes.io/projected/f1344ba6-29ab-465d-bff0-294dda5c3c9b-kube-api-access-8r4p4\") pod \"payload-pre-processing-687dbb6cf6-gj62g\" (UID: \"f1344ba6-29ab-465d-bff0-294dda5c3c9b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:39.068446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.068280    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1344ba6-29ab-465d-bff0-294dda5c3c9b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gj62g\" (UID: \"f1344ba6-29ab-465d-bff0-294dda5c3c9b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:39.068446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.068335    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6jvm\" (UniqueName: \"kubernetes.io/projected/c8dddd89-3c2d-45df-98e6-e2286c997831-kube-api-access-r6jvm\") pod \"payload-processing-5cc6cd444b-7rcs8\" (UID: \"c8dddd89-3c2d-45df-98e6-e2286c997831\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.068446 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.068367    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8dddd89-3c2d-45df-98e6-e2286c997831-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-7rcs8\" (UID: \"c8dddd89-3c2d-45df-98e6-e2286c997831\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.068977 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.068956    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f1344ba6-29ab-465d-bff0-294dda5c3c9b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-gj62g\" (UID: \"f1344ba6-29ab-465d-bff0-294dda5c3c9b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:39.076873 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.076852    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r4p4\" (UniqueName: \"kubernetes.io/projected/f1344ba6-29ab-465d-bff0-294dda5c3c9b-kube-api-access-8r4p4\") pod \"payload-pre-processing-687dbb6cf6-gj62g\" (UID: \"f1344ba6-29ab-465d-bff0-294dda5c3c9b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:39.168911 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.168818    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6jvm\" (UniqueName: \"kubernetes.io/projected/c8dddd89-3c2d-45df-98e6-e2286c997831-kube-api-access-r6jvm\") pod \"payload-processing-5cc6cd444b-7rcs8\" (UID: \"c8dddd89-3c2d-45df-98e6-e2286c997831\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.168911 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.168866    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8dddd89-3c2d-45df-98e6-e2286c997831-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-7rcs8\" (UID: \"c8dddd89-3c2d-45df-98e6-e2286c997831\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.169633 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.169610    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c8dddd89-3c2d-45df-98e6-e2286c997831-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-7rcs8\" (UID: \"c8dddd89-3c2d-45df-98e6-e2286c997831\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.176702 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.176674    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6jvm\" (UniqueName: \"kubernetes.io/projected/c8dddd89-3c2d-45df-98e6-e2286c997831-kube-api-access-r6jvm\") pod \"payload-processing-5cc6cd444b-7rcs8\" (UID: \"c8dddd89-3c2d-45df-98e6-e2286c997831\") " pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.216605 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.216570    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:39.241599 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.241571    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:39.367679 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.367649    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"]
Jul 29 01:21:39.370374 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:21:39.370332    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1344ba6_29ab_465d_bff0_294dda5c3c9b.slice/crio-65f785a9874d0b593a60d9cb353934266c82884a95631e08cad3a15d9e5bf193 WatchSource:0}: Error finding container 65f785a9874d0b593a60d9cb353934266c82884a95631e08cad3a15d9e5bf193: Status 404 returned error can't find the container with id 65f785a9874d0b593a60d9cb353934266c82884a95631e08cad3a15d9e5bf193
Jul 29 01:21:39.390717 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.390692    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-7rcs8"]
Jul 29 01:21:39.392472 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:21:39.392448    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8dddd89_3c2d_45df_98e6_e2286c997831.slice/crio-b110041fd10c715fcb46b597dc1327db0eea0661ebc5f030da936446bd045612 WatchSource:0}: Error finding container b110041fd10c715fcb46b597dc1327db0eea0661ebc5f030da936446bd045612: Status 404 returned error can't find the container with id b110041fd10c715fcb46b597dc1327db0eea0661ebc5f030da936446bd045612
Jul 29 01:21:39.521577 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.521494    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8" event={"ID":"c8dddd89-3c2d-45df-98e6-e2286c997831","Type":"ContainerStarted","Data":"b110041fd10c715fcb46b597dc1327db0eea0661ebc5f030da936446bd045612"}
Jul 29 01:21:39.521577 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:39.521544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g" event={"ID":"f1344ba6-29ab-465d-bff0-294dda5c3c9b","Type":"ContainerStarted","Data":"65f785a9874d0b593a60d9cb353934266c82884a95631e08cad3a15d9e5bf193"}
Jul 29 01:21:42.534745 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:42.534691    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g" event={"ID":"f1344ba6-29ab-465d-bff0-294dda5c3c9b","Type":"ContainerStarted","Data":"1c5c00e7507044813c9c5731d2c52d6c17e2ceb0c52e1ba1d7f90cfc8044e0ec"}
Jul 29 01:21:42.535180 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:42.534768    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:42.536272 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:42.536237    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8" event={"ID":"c8dddd89-3c2d-45df-98e6-e2286c997831","Type":"ContainerStarted","Data":"17b98742842e47d943bb1187055eb9d98bb5a2717ed8d0fbe2c5d39940f5b8a1"}
Jul 29 01:21:42.536366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:42.536327    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:21:42.552442 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:42.552394    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g" podStartSLOduration=2.35750842 podStartE2EDuration="4.552377654s" totalImagesPullingTime="2.194869234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:42.550771308 +0000 UTC m=+735.542736977" watchObservedRunningTime="2026-07-29 01:21:42.552377654 +0000 UTC m=+735.544343321"
Jul 29 01:21:42.566659 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:42.566616    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8" podStartSLOduration=2.402956238 podStartE2EDuration="4.566605232s" totalImagesPullingTime="2.163648994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:21:42.565310692 +0000 UTC m=+735.557276361" watchObservedRunningTime="2026-07-29 01:21:42.566605232 +0000 UTC m=+735.558570943"
Jul 29 01:21:53.543044 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:53.543005    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-gj62g"
Jul 29 01:21:53.543635 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:21:53.543090    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-7rcs8"
Jul 29 01:22:21.192191 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.192147    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"]
Jul 29 01:22:21.198292 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.198238    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.201102 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.201071    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:22:21.202070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.202041    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:22:21.202164 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.202134    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 29 01:22:21.202231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.202209    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-s5586\""
Jul 29 01:22:21.205850 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.205808    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"]
Jul 29 01:22:21.254733 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.254694    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8sgt\" (UniqueName: \"kubernetes.io/projected/f3735427-75c0-4f31-90dd-930f18691e72-kube-api-access-d8sgt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.254900 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.254780    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3735427-75c0-4f31-90dd-930f18691e72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.254952 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.254903    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.254952 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.254945    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.255035 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.254987    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.255035 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.255010    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356357 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356306    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356357 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356360    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356629 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356393    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8sgt\" (UniqueName: \"kubernetes.io/projected/f3735427-75c0-4f31-90dd-930f18691e72-kube-api-access-d8sgt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356629 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3735427-75c0-4f31-90dd-930f18691e72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356629 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356526    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356670    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356779    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356806    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.356979 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.356950    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.359022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.358978    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3735427-75c0-4f31-90dd-930f18691e72-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.359345 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.359317    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3735427-75c0-4f31-90dd-930f18691e72-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.364900 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.364871    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8sgt\" (UniqueName: \"kubernetes.io/projected/f3735427-75c0-4f31-90dd-930f18691e72-kube-api-access-d8sgt\") pod \"e2e-trlp-test-simulated-kserve-598466548d-clj9j\" (UID: \"f3735427-75c0-4f31-90dd-930f18691e72\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.513836 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.513706    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:21.670479 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.670447    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"]
Jul 29 01:22:21.673508 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:22:21.673452    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3735427_75c0_4f31_90dd_930f18691e72.slice/crio-b31fa5e206c9bdcd745029910f9fbe62614b1eb47422e0128d5f0c50dfefa72d WatchSource:0}: Error finding container b31fa5e206c9bdcd745029910f9fbe62614b1eb47422e0128d5f0c50dfefa72d: Status 404 returned error can't find the container with id b31fa5e206c9bdcd745029910f9fbe62614b1eb47422e0128d5f0c50dfefa72d
Jul 29 01:22:21.718636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:21.718594    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j" event={"ID":"f3735427-75c0-4f31-90dd-930f18691e72","Type":"ContainerStarted","Data":"b31fa5e206c9bdcd745029910f9fbe62614b1eb47422e0128d5f0c50dfefa72d"}
Jul 29 01:22:23.731681 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:23.731636    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j" event={"ID":"f3735427-75c0-4f31-90dd-930f18691e72","Type":"ContainerStarted","Data":"2057cb2b3004e79d40e9ec9cfc564c1ad06d90c7f7b7569e81054d26b1390ebd"}
Jul 29 01:22:23.762287 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:23.762183    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j" podStartSLOduration=1.68429976 podStartE2EDuration="2.762160331s" totalImagesPullingTime="1.077860571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:23.761022241 +0000 UTC m=+776.752987910" watchObservedRunningTime="2026-07-29 01:22:23.762160331 +0000 UTC m=+776.754126090"
Jul 29 01:22:31.514084 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:31.514043    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:31.514584 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:31.514142    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:31.527371 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:31.527326    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:31.784440 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:31.784347    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-clj9j"
Jul 29 01:22:42.402096 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.402039    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"]
Jul 29 01:22:42.406495 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.406404    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.410080 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.410040    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 01:22:42.429989 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.429948    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"]
Jul 29 01:22:42.553891 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.553834    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.553891 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.553897    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.554121 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.553966    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6th5\" (UniqueName: \"kubernetes.io/projected/17d449dd-fc69-4fa9-81d6-c788fd36cdae-kube-api-access-n6th5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.554121 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.554036    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17d449dd-fc69-4fa9-81d6-c788fd36cdae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.554121 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.554104    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.554222 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.554122    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655341 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655225    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655537 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655388    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655537 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655444    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655537 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655503    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655800 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655554    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6th5\" (UniqueName: \"kubernetes.io/projected/17d449dd-fc69-4fa9-81d6-c788fd36cdae-kube-api-access-n6th5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655800 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655606    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17d449dd-fc69-4fa9-81d6-c788fd36cdae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655800 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655651    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.655954 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655846    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.656005 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.655947    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.657921 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.657875    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17d449dd-fc69-4fa9-81d6-c788fd36cdae-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.658392 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.658370    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17d449dd-fc69-4fa9-81d6-c788fd36cdae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.676912 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.676870    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6th5\" (UniqueName: \"kubernetes.io/projected/17d449dd-fc69-4fa9-81d6-c788fd36cdae-kube-api-access-n6th5\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9gt6k\" (UID: \"17d449dd-fc69-4fa9-81d6-c788fd36cdae\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.719752 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.719708    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:42.889637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:42.889540    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"]
Jul 29 01:22:42.892889 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:22:42.892853    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17d449dd_fc69_4fa9_81d6_c788fd36cdae.slice/crio-e5f8c00dd1b3ce006c56a07a3defa7f381e88305ec5d37668c42da6617e5d77c WatchSource:0}: Error finding container e5f8c00dd1b3ce006c56a07a3defa7f381e88305ec5d37668c42da6617e5d77c: Status 404 returned error can't find the container with id e5f8c00dd1b3ce006c56a07a3defa7f381e88305ec5d37668c42da6617e5d77c
Jul 29 01:22:43.833124 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:43.833077    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k" event={"ID":"17d449dd-fc69-4fa9-81d6-c788fd36cdae","Type":"ContainerStarted","Data":"d65fa4ac0800db487344f2dc2f6213e287182986c143cec7412636f7ca5f5048"}
Jul 29 01:22:43.833599 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:43.833143    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k" event={"ID":"17d449dd-fc69-4fa9-81d6-c788fd36cdae","Type":"ContainerStarted","Data":"e5f8c00dd1b3ce006c56a07a3defa7f381e88305ec5d37668c42da6617e5d77c"}
Jul 29 01:22:43.851646 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:43.851574    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k" podStartSLOduration=1.673118525 podStartE2EDuration="1.85155238s" totalImagesPullingTime="178.433855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:22:43.850083413 +0000 UTC m=+796.842049093" watchObservedRunningTime="2026-07-29 01:22:43.85155238 +0000 UTC m=+796.843518048"
Jul 29 01:22:52.720227 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:52.720176    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:52.720753 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:52.720285    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:52.734136 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:52.734103    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:22:52.899017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:22:52.898967    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9gt6k"
Jul 29 01:23:59.783242 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:23:59.783194    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-df5b68fbd-gzxj2"]
Jul 29 01:23:59.786024 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:23:59.785997    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:23:59.795859 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:23:59.795817    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-df5b68fbd-gzxj2"]
Jul 29 01:23:59.906409 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:23:59.906365    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89vkf\" (UniqueName: \"kubernetes.io/projected/45049900-2343-41f1-8081-2f30cba7309b-kube-api-access-89vkf\") pod \"authorino-df5b68fbd-gzxj2\" (UID: \"45049900-2343-41f1-8081-2f30cba7309b\") " pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:23:59.906409 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:23:59.906409    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45049900-2343-41f1-8081-2f30cba7309b-tls-cert\") pod \"authorino-df5b68fbd-gzxj2\" (UID: \"45049900-2343-41f1-8081-2f30cba7309b\") " pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:24:00.007805 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:00.007750    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89vkf\" (UniqueName: \"kubernetes.io/projected/45049900-2343-41f1-8081-2f30cba7309b-kube-api-access-89vkf\") pod \"authorino-df5b68fbd-gzxj2\" (UID: \"45049900-2343-41f1-8081-2f30cba7309b\") " pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:24:00.007805 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:00.007803    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45049900-2343-41f1-8081-2f30cba7309b-tls-cert\") pod \"authorino-df5b68fbd-gzxj2\" (UID: \"45049900-2343-41f1-8081-2f30cba7309b\") " pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:24:00.010578 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:00.010536    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45049900-2343-41f1-8081-2f30cba7309b-tls-cert\") pod \"authorino-df5b68fbd-gzxj2\" (UID: \"45049900-2343-41f1-8081-2f30cba7309b\") " pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:24:00.016597 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:00.016552    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89vkf\" (UniqueName: \"kubernetes.io/projected/45049900-2343-41f1-8081-2f30cba7309b-kube-api-access-89vkf\") pod \"authorino-df5b68fbd-gzxj2\" (UID: \"45049900-2343-41f1-8081-2f30cba7309b\") " pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:24:00.097537 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:00.097423    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-df5b68fbd-gzxj2"
Jul 29 01:24:00.250079 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:00.250042    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-df5b68fbd-gzxj2"]
Jul 29 01:24:01.227748 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.227676    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df5b68fbd-gzxj2" event={"ID":"45049900-2343-41f1-8081-2f30cba7309b","Type":"ContainerStarted","Data":"2c0357641778eaff1a7dbf2c5442c38d8d483ffe26d6a877eae05c86489ff8b0"}
Jul 29 01:24:01.227748 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.227738    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-df5b68fbd-gzxj2" event={"ID":"45049900-2343-41f1-8081-2f30cba7309b","Type":"ContainerStarted","Data":"8745d0b966ca8f58dba65df1b3426f794fd891a208f0cc999f3e51cce954919f"}
Jul 29 01:24:01.247481 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.247391    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-df5b68fbd-gzxj2" podStartSLOduration=1.8206503870000001 podStartE2EDuration="2.247360166s" totalImagesPullingTime="426.709779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:24:01.246065037 +0000 UTC m=+874.238030707" watchObservedRunningTime="2026-07-29 01:24:01.247360166 +0000 UTC m=+874.239325926"
Jul 29 01:24:01.284283 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.283881    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8cbf96dc7-f8242"]
Jul 29 01:24:01.284283 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.284151    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8cbf96dc7-f8242" podUID="697a0517-2cee-4719-907c-eb481481925b" containerName="authorino" containerID="cri-o://8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509" gracePeriod=30
Jul 29 01:24:01.559666 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.559633    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:24:01.725746 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.725705    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7xkz\" (UniqueName: \"kubernetes.io/projected/697a0517-2cee-4719-907c-eb481481925b-kube-api-access-f7xkz\") pod \"697a0517-2cee-4719-907c-eb481481925b\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") "
Jul 29 01:24:01.725959 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.725770    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697a0517-2cee-4719-907c-eb481481925b-tls-cert\") pod \"697a0517-2cee-4719-907c-eb481481925b\" (UID: \"697a0517-2cee-4719-907c-eb481481925b\") "
Jul 29 01:24:01.728098 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.728058    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697a0517-2cee-4719-907c-eb481481925b-kube-api-access-f7xkz" (OuterVolumeSpecName: "kube-api-access-f7xkz") pod "697a0517-2cee-4719-907c-eb481481925b" (UID: "697a0517-2cee-4719-907c-eb481481925b"). InnerVolumeSpecName "kube-api-access-f7xkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:24:01.736521 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.736492    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/697a0517-2cee-4719-907c-eb481481925b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "697a0517-2cee-4719-907c-eb481481925b" (UID: "697a0517-2cee-4719-907c-eb481481925b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:24:01.827398 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.827285    2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/697a0517-2cee-4719-907c-eb481481925b-tls-cert\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:24:01.827398 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:01.827330    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7xkz\" (UniqueName: \"kubernetes.io/projected/697a0517-2cee-4719-907c-eb481481925b-kube-api-access-f7xkz\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:24:02.234960 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.234916    2557 generic.go:356] "Generic (PLEG): container finished" podID="697a0517-2cee-4719-907c-eb481481925b" containerID="8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509" exitCode=0
Jul 29 01:24:02.235520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.234993    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8cbf96dc7-f8242"
Jul 29 01:24:02.235520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.234995    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8cbf96dc7-f8242" event={"ID":"697a0517-2cee-4719-907c-eb481481925b","Type":"ContainerDied","Data":"8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509"}
Jul 29 01:24:02.235520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.235044    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8cbf96dc7-f8242" event={"ID":"697a0517-2cee-4719-907c-eb481481925b","Type":"ContainerDied","Data":"4ed98c5f52b6bfdb572662d5a1de8f4100d17d62e27711ccb957a82fc319fa53"}
Jul 29 01:24:02.235520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.235063    2557 scope.go:117] "RemoveContainer" containerID="8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509"
Jul 29 01:24:02.246183 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.246153    2557 scope.go:117] "RemoveContainer" containerID="8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509"
Jul 29 01:24:02.246660 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:24:02.246629    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509\": container with ID starting with 8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509 not found: ID does not exist" containerID="8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509"
Jul 29 01:24:02.246779 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.246673    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509"} err="failed to get container status \"8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509\": rpc error: code = NotFound desc = could not find container \"8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509\": container with ID starting with 8f2891c0f789b1fd3b17dc7c4c133114b5cc8411bd3558b3c706446bdcec3509 not found: ID does not exist"
Jul 29 01:24:02.258000 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.257946    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8cbf96dc7-f8242"]
Jul 29 01:24:02.261478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:02.261433    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8cbf96dc7-f8242"]
Jul 29 01:24:03.523022 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:24:03.522970    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="697a0517-2cee-4719-907c-eb481481925b" path="/var/lib/kubelet/pods/697a0517-2cee-4719-907c-eb481481925b/volumes"
Jul 29 01:35:16.608830 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.608787    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"]
Jul 29 01:35:16.610691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.609177    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697a0517-2cee-4719-907c-eb481481925b" containerName="authorino"
Jul 29 01:35:16.610691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.609190    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="697a0517-2cee-4719-907c-eb481481925b" containerName="authorino"
Jul 29 01:35:16.610691 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.609281    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="697a0517-2cee-4719-907c-eb481481925b" containerName="authorino"
Jul 29 01:35:16.611472 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.611447    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.614244 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.614184    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-ae9e05f4-kserve-self-signed-certs\""
Jul 29 01:35:16.634529 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.634493    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"]
Jul 29 01:35:16.723647 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.723597    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-model-cache\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.723839 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.723668    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fqmb\" (UniqueName: \"kubernetes.io/projected/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-kube-api-access-6fqmb\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.723839 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.723761    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-dshm\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.723839 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.723787    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tmp-dir\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.723839 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.723816    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tls-certs\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.723978 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.723889    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-home\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825160 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825110    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fqmb\" (UniqueName: \"kubernetes.io/projected/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-kube-api-access-6fqmb\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825399 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825192    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-dshm\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825399 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825214    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tmp-dir\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825399 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825238    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tls-certs\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825399 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825287    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-home\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825399 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825319    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-model-cache\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825794 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825755    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-model-cache\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825794 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825787    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-home\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.825965 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.825757    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tmp-dir\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.827900 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.827858    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-dshm\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.828223 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.828195    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tls-certs\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.835431 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.835382    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fqmb\" (UniqueName: \"kubernetes.io/projected/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-kube-api-access-6fqmb\") pod \"e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") " pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:16.923291 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:16.923168    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:17.076690 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:17.076654    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"]
Jul 29 01:35:17.079445 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:35:17.079402    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dda0ee1_fe03_4ff6_9d8c_145abcbcc5ff.slice/crio-325e623d94e2c802d1ce2dc3e3717970cf953f73b7a9b806852af43cd5f55219 WatchSource:0}: Error finding container 325e623d94e2c802d1ce2dc3e3717970cf953f73b7a9b806852af43cd5f55219: Status 404 returned error can't find the container with id 325e623d94e2c802d1ce2dc3e3717970cf953f73b7a9b806852af43cd5f55219
Jul 29 01:35:17.587581 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:17.587534    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f" event={"ID":"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff","Type":"ContainerStarted","Data":"0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d"}
Jul 29 01:35:17.587581 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:17.587583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f" event={"ID":"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff","Type":"ContainerStarted","Data":"325e623d94e2c802d1ce2dc3e3717970cf953f73b7a9b806852af43cd5f55219"}
Jul 29 01:35:17.614456 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:17.614376    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f" podStartSLOduration=1.614351012 podStartE2EDuration="1.614351012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:35:17.613302335 +0000 UTC m=+1550.605268005" watchObservedRunningTime="2026-07-29 01:35:17.614351012 +0000 UTC m=+1550.606316680"
Jul 29 01:35:26.923969 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:26.923915    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:26.924480 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:26.923990    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:26.938102 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:26.938062    2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:27.653702 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:27.653667    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:35:52.034418 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:35:52.034375    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"]
Jul 29 01:36:07.055171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.055099    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f" podUID="5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" containerName="main" containerID="cri-o://0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d" gracePeriod=45
Jul 29 01:36:07.319950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.319868    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:36:07.434880 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.434831    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-model-cache\") pod \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") "
Jul 29 01:36:07.434880 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.434883    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-home\") pod \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") "
Jul 29 01:36:07.435141 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.434928    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fqmb\" (UniqueName: \"kubernetes.io/projected/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-kube-api-access-6fqmb\") pod \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") "
Jul 29 01:36:07.435141 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.434968    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tmp-dir\") pod \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") "
Jul 29 01:36:07.435141 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435001    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-dshm\") pod \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") "
Jul 29 01:36:07.435141 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435062    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tls-certs\") pod \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\" (UID: \"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff\") "
Jul 29 01:36:07.435386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435164    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-model-cache" (OuterVolumeSpecName: "model-cache") pod "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" (UID: "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:07.435386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435307    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" (UID: "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:07.435386 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435320    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-home" (OuterVolumeSpecName: "home") pod "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" (UID: "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:07.435532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435474    2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-model-cache\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:36:07.435532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435493    2557 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-home\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:36:07.435532 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.435509    2557 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tmp-dir\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:36:07.437477 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.437435    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-dshm" (OuterVolumeSpecName: "dshm") pod "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" (UID: "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:36:07.437597 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.437514    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-kube-api-access-6fqmb" (OuterVolumeSpecName: "kube-api-access-6fqmb") pod "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" (UID: "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff"). InnerVolumeSpecName "kube-api-access-6fqmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:36:07.437597 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.437512    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" (UID: "5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:36:07.536643 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.536600    2557 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-dshm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:36:07.536643 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.536638    2557 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-tls-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:36:07.536643 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.536652    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fqmb\" (UniqueName: \"kubernetes.io/projected/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff-kube-api-access-6fqmb\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:36:07.849738 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.849697    2557 generic.go:356] "Generic (PLEG): container finished" podID="5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" containerID="0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d" exitCode=0
Jul 29 01:36:07.849950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.849766    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"
Jul 29 01:36:07.849950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.849782    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f" event={"ID":"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff","Type":"ContainerDied","Data":"0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d"}
Jul 29 01:36:07.849950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.849833    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f" event={"ID":"5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff","Type":"ContainerDied","Data":"325e623d94e2c802d1ce2dc3e3717970cf953f73b7a9b806852af43cd5f55219"}
Jul 29 01:36:07.849950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.849853    2557 scope.go:117] "RemoveContainer" containerID="0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d"
Jul 29 01:36:07.859088 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.859065    2557 scope.go:117] "RemoveContainer" containerID="0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d"
Jul 29 01:36:07.859508 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:36:07.859483    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d\": container with ID starting with 0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d not found: ID does not exist" containerID="0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d"
Jul 29 01:36:07.859597 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.859516    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d"} err="failed to get container status \"0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d\": rpc error: code = NotFound desc = could not find container \"0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d\": container with ID starting with 0146dd0d9375c32c69d723717f86a4a707ea8a35f9bd32abe547f19424c07f9d not found: ID does not exist"
Jul 29 01:36:07.870953 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.870900    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"]
Jul 29 01:36:07.872750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:07.872711    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-ae9e05f4-kserve-5d86bcc695-hdh2f"]
Jul 29 01:36:09.522757 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:36:09.522711    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" path="/var/lib/kubelet/pods/5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff/volumes"
Jul 29 01:39:35.284338 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.284302    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"]
Jul 29 01:39:35.284902 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.284657    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" containerName="main"
Jul 29 01:39:35.284902 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.284667    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" containerName="main"
Jul 29 01:39:35.284902 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.284725    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dda0ee1-fe03-4ff6-9d8c-145abcbcc5ff" containerName="main"
Jul 29 01:39:35.287775 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.287758    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.292219 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.292197    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9acc92f8\""
Jul 29 01:39:35.302936 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.302913    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"]
Jul 29 01:39:35.363600 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.363570    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9c65592-0dad-4d97-8cf2-952ffc92393c-plugins-config-volume\") pod \"payload-processing-e2e-ait-9acc92f8-687d46c858-478kg\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") " pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.363600 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.363600    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5xv\" (UniqueName: \"kubernetes.io/projected/f9c65592-0dad-4d97-8cf2-952ffc92393c-kube-api-access-qh5xv\") pod \"payload-processing-e2e-ait-9acc92f8-687d46c858-478kg\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") " pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.381551 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.378863    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"]
Jul 29 01:39:35.383875 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.383841    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.387769 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.387750    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9acc92f8-dockercfg-ft72p\""
Jul 29 01:39:35.397608 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.397588    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"]
Jul 29 01:39:35.464458 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.464432    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9c65592-0dad-4d97-8cf2-952ffc92393c-plugins-config-volume\") pod \"payload-processing-e2e-ait-9acc92f8-687d46c858-478kg\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") " pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.464580 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.464459    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5xv\" (UniqueName: \"kubernetes.io/projected/f9c65592-0dad-4d97-8cf2-952ffc92393c-kube-api-access-qh5xv\") pod \"payload-processing-e2e-ait-9acc92f8-687d46c858-478kg\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") " pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.464580 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.464493    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8mmx\" (UniqueName: \"kubernetes.io/projected/39212184-05af-45d6-aa95-c577982b8175-kube-api-access-n8mmx\") pod \"payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.464580 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.464555    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39212184-05af-45d6-aa95-c577982b8175-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.465132 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.465108    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9c65592-0dad-4d97-8cf2-952ffc92393c-plugins-config-volume\") pod \"payload-processing-e2e-ait-9acc92f8-687d46c858-478kg\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") " pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.474688 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.474667    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5xv\" (UniqueName: \"kubernetes.io/projected/f9c65592-0dad-4d97-8cf2-952ffc92393c-kube-api-access-qh5xv\") pod \"payload-processing-e2e-ait-9acc92f8-687d46c858-478kg\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") " pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.565598 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.565538    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8mmx\" (UniqueName: \"kubernetes.io/projected/39212184-05af-45d6-aa95-c577982b8175-kube-api-access-n8mmx\") pod \"payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.565690 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.565610    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39212184-05af-45d6-aa95-c577982b8175-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.566248 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.566229    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39212184-05af-45d6-aa95-c577982b8175-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.573658 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.573633    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8mmx\" (UniqueName: \"kubernetes.io/projected/39212184-05af-45d6-aa95-c577982b8175-kube-api-access-n8mmx\") pod \"payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.597416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.597390    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.693538 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.693503    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:35.732138 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.732111    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"]
Jul 29 01:39:35.735386 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:39:35.735345    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9c65592_0dad_4d97_8cf2_952ffc92393c.slice/crio-cef2fe7c63c2b816c56b71742fed048f5e4029562d1ef2ec86fe87aa3d518c69 WatchSource:0}: Error finding container cef2fe7c63c2b816c56b71742fed048f5e4029562d1ef2ec86fe87aa3d518c69: Status 404 returned error can't find the container with id cef2fe7c63c2b816c56b71742fed048f5e4029562d1ef2ec86fe87aa3d518c69
Jul 29 01:39:35.815029 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.814993    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg" event={"ID":"f9c65592-0dad-4d97-8cf2-952ffc92393c","Type":"ContainerStarted","Data":"fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366"}
Jul 29 01:39:35.815175 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.815157    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:35.815449 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.815208    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg" event={"ID":"f9c65592-0dad-4d97-8cf2-952ffc92393c","Type":"ContainerStarted","Data":"cef2fe7c63c2b816c56b71742fed048f5e4029562d1ef2ec86fe87aa3d518c69"}
Jul 29 01:39:35.832172 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.832071    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg" podStartSLOduration=0.8320506 podStartE2EDuration="832.0506ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:39:35.831362323 +0000 UTC m=+1808.823327992" watchObservedRunningTime="2026-07-29 01:39:35.8320506 +0000 UTC m=+1808.824016270"
Jul 29 01:39:35.836979 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:39:35.836952    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39212184_05af_45d6_aa95_c577982b8175.slice/crio-bc676047b98c6b18e5c91ec9f16969579840d3455c2ea00b3ca256348d42ad59 WatchSource:0}: Error finding container bc676047b98c6b18e5c91ec9f16969579840d3455c2ea00b3ca256348d42ad59: Status 404 returned error can't find the container with id bc676047b98c6b18e5c91ec9f16969579840d3455c2ea00b3ca256348d42ad59
Jul 29 01:39:35.836979 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:35.836959    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"]
Jul 29 01:39:36.821592 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:36.821536    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm" event={"ID":"39212184-05af-45d6-aa95-c577982b8175","Type":"ContainerStarted","Data":"affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30"}
Jul 29 01:39:36.822056 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:36.821609    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm" event={"ID":"39212184-05af-45d6-aa95-c577982b8175","Type":"ContainerStarted","Data":"bc676047b98c6b18e5c91ec9f16969579840d3455c2ea00b3ca256348d42ad59"}
Jul 29 01:39:36.839098 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:36.839041    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm" podStartSLOduration=1.839026816 podStartE2EDuration="1.839026816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:39:36.837393092 +0000 UTC m=+1809.829358761" watchObservedRunningTime="2026-07-29 01:39:36.839026816 +0000 UTC m=+1809.830992500"
Jul 29 01:39:37.826475 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:37.826440    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:39:46.824328 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:46.824298    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:39:48.833034 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:39:48.833004    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:42:48.905805 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:48.905757    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"]
Jul 29 01:42:48.906476 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:48.906012    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg" podUID="f9c65592-0dad-4d97-8cf2-952ffc92393c" containerName="payload-processing" containerID="cri-o://fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366" gracePeriod=30
Jul 29 01:42:48.915961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:48.915918    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"]
Jul 29 01:42:48.916328 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:48.916232    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm" podUID="39212184-05af-45d6-aa95-c577982b8175" containerName="payload-pre-processing" containerID="cri-o://affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30" gracePeriod=30
Jul 29 01:42:49.211040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.211005    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:42:49.214874 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.214815    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:42:49.373602 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.373541    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh5xv\" (UniqueName: \"kubernetes.io/projected/f9c65592-0dad-4d97-8cf2-952ffc92393c-kube-api-access-qh5xv\") pod \"f9c65592-0dad-4d97-8cf2-952ffc92393c\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") "
Jul 29 01:42:49.373602 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.373609    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39212184-05af-45d6-aa95-c577982b8175-plugins-config-volume\") pod \"39212184-05af-45d6-aa95-c577982b8175\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") "
Jul 29 01:42:49.373888 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.373691    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9c65592-0dad-4d97-8cf2-952ffc92393c-plugins-config-volume\") pod \"f9c65592-0dad-4d97-8cf2-952ffc92393c\" (UID: \"f9c65592-0dad-4d97-8cf2-952ffc92393c\") "
Jul 29 01:42:49.373888 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.373715    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8mmx\" (UniqueName: \"kubernetes.io/projected/39212184-05af-45d6-aa95-c577982b8175-kube-api-access-n8mmx\") pod \"39212184-05af-45d6-aa95-c577982b8175\" (UID: \"39212184-05af-45d6-aa95-c577982b8175\") "
Jul 29 01:42:49.374142 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.374110    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9c65592-0dad-4d97-8cf2-952ffc92393c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9c65592-0dad-4d97-8cf2-952ffc92393c" (UID: "f9c65592-0dad-4d97-8cf2-952ffc92393c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:49.374221 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.374109    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39212184-05af-45d6-aa95-c577982b8175-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39212184-05af-45d6-aa95-c577982b8175" (UID: "39212184-05af-45d6-aa95-c577982b8175"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:42:49.376198 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.376161    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9c65592-0dad-4d97-8cf2-952ffc92393c-kube-api-access-qh5xv" (OuterVolumeSpecName: "kube-api-access-qh5xv") pod "f9c65592-0dad-4d97-8cf2-952ffc92393c" (UID: "f9c65592-0dad-4d97-8cf2-952ffc92393c"). InnerVolumeSpecName "kube-api-access-qh5xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:49.376293 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.376217    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39212184-05af-45d6-aa95-c577982b8175-kube-api-access-n8mmx" (OuterVolumeSpecName: "kube-api-access-n8mmx") pod "39212184-05af-45d6-aa95-c577982b8175" (UID: "39212184-05af-45d6-aa95-c577982b8175"). InnerVolumeSpecName "kube-api-access-n8mmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:42:49.474641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.474540    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh5xv\" (UniqueName: \"kubernetes.io/projected/f9c65592-0dad-4d97-8cf2-952ffc92393c-kube-api-access-qh5xv\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.474641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.474576    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39212184-05af-45d6-aa95-c577982b8175-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.474641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.474587    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9c65592-0dad-4d97-8cf2-952ffc92393c-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.474641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.474595    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8mmx\" (UniqueName: \"kubernetes.io/projected/39212184-05af-45d6-aa95-c577982b8175-kube-api-access-n8mmx\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:42:49.771709 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.771608    2557 generic.go:356] "Generic (PLEG): container finished" podID="f9c65592-0dad-4d97-8cf2-952ffc92393c" containerID="fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366" exitCode=0
Jul 29 01:42:49.771709 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.771676    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"
Jul 29 01:42:49.771709 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.771698    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg" event={"ID":"f9c65592-0dad-4d97-8cf2-952ffc92393c","Type":"ContainerDied","Data":"fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366"}
Jul 29 01:42:49.771981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.771789    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg" event={"ID":"f9c65592-0dad-4d97-8cf2-952ffc92393c","Type":"ContainerDied","Data":"cef2fe7c63c2b816c56b71742fed048f5e4029562d1ef2ec86fe87aa3d518c69"}
Jul 29 01:42:49.771981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.771828    2557 scope.go:117] "RemoveContainer" containerID="fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366"
Jul 29 01:42:49.773868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.773832    2557 generic.go:356] "Generic (PLEG): container finished" podID="39212184-05af-45d6-aa95-c577982b8175" containerID="affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30" exitCode=0
Jul 29 01:42:49.774009 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.773949    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm" event={"ID":"39212184-05af-45d6-aa95-c577982b8175","Type":"ContainerDied","Data":"affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30"}
Jul 29 01:42:49.774132 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.774008    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm" event={"ID":"39212184-05af-45d6-aa95-c577982b8175","Type":"ContainerDied","Data":"bc676047b98c6b18e5c91ec9f16969579840d3455c2ea00b3ca256348d42ad59"}
Jul 29 01:42:49.774132 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.774104    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"
Jul 29 01:42:49.782540 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.782515    2557 scope.go:117] "RemoveContainer" containerID="fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366"
Jul 29 01:42:49.782920 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:42:49.782895    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366\": container with ID starting with fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366 not found: ID does not exist" containerID="fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366"
Jul 29 01:42:49.782978 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.782932    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366"} err="failed to get container status \"fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366\": rpc error: code = NotFound desc = could not find container \"fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366\": container with ID starting with fdff9d002cc9dbfc03446820df68740166ef3b2fc75e9711c491a3a546d02366 not found: ID does not exist"
Jul 29 01:42:49.782978 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.782954    2557 scope.go:117] "RemoveContainer" containerID="affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30"
Jul 29 01:42:49.792503 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.792476    2557 scope.go:117] "RemoveContainer" containerID="affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30"
Jul 29 01:42:49.792893 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:42:49.792869    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30\": container with ID starting with affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30 not found: ID does not exist" containerID="affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30"
Jul 29 01:42:49.792973 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.792899    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30"} err="failed to get container status \"affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30\": rpc error: code = NotFound desc = could not find container \"affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30\": container with ID starting with affffc835f6b73f333d52383227b52282c41aef0a7dfef32ab98e40d1464af30 not found: ID does not exist"
Jul 29 01:42:49.806033 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.805972    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"]
Jul 29 01:42:49.813730 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.813684    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9acc92f8-687d46c858-478kg"]
Jul 29 01:42:49.844049 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.844008    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"]
Jul 29 01:42:49.857909 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:49.857871    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9acc92f8-5b6c8cd99b-pzzzm"]
Jul 29 01:42:51.523307 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:51.523237    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39212184-05af-45d6-aa95-c577982b8175" path="/var/lib/kubelet/pods/39212184-05af-45d6-aa95-c577982b8175/volumes"
Jul 29 01:42:51.523724 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:51.523661    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9c65592-0dad-4d97-8cf2-952ffc92393c" path="/var/lib/kubelet/pods/f9c65592-0dad-4d97-8cf2-952ffc92393c/volumes"
Jul 29 01:42:52.723636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.723597    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"]
Jul 29 01:42:52.724159 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.724142    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9c65592-0dad-4d97-8cf2-952ffc92393c" containerName="payload-processing"
Jul 29 01:42:52.724159 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.724160    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9c65592-0dad-4d97-8cf2-952ffc92393c" containerName="payload-processing"
Jul 29 01:42:52.724345 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.724172    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39212184-05af-45d6-aa95-c577982b8175" containerName="payload-pre-processing"
Jul 29 01:42:52.724345 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.724180    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="39212184-05af-45d6-aa95-c577982b8175" containerName="payload-pre-processing"
Jul 29 01:42:52.724345 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.724299    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="39212184-05af-45d6-aa95-c577982b8175" containerName="payload-pre-processing"
Jul 29 01:42:52.724345 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.724317    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9c65592-0dad-4d97-8cf2-952ffc92393c" containerName="payload-processing"
Jul 29 01:42:52.729274 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.729228    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:52.732134 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.732105    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-3a585460-serving-cert\""
Jul 29 01:42:52.732274 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.732120    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7b9zw\""
Jul 29 01:42:52.739749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.739721    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"]
Jul 29 01:42:52.910648 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.910607    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrd6p\" (UniqueName: \"kubernetes.io/projected/3a769970-95dd-411f-8b0c-1bf49dc80aae-kube-api-access-vrd6p\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:52.910648 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.910663    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a769970-95dd-411f-8b0c-1bf49dc80aae-maas-api-tls\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:52.910883 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:52.910731    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a769970-95dd-411f-8b0c-1bf49dc80aae-openshift-service-ca\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.012205 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.012105    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrd6p\" (UniqueName: \"kubernetes.io/projected/3a769970-95dd-411f-8b0c-1bf49dc80aae-kube-api-access-vrd6p\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.012205 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.012163    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a769970-95dd-411f-8b0c-1bf49dc80aae-maas-api-tls\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.012205 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.012201    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a769970-95dd-411f-8b0c-1bf49dc80aae-openshift-service-ca\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.012900 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.012876    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a769970-95dd-411f-8b0c-1bf49dc80aae-openshift-service-ca\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.014905 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.014877    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a769970-95dd-411f-8b0c-1bf49dc80aae-maas-api-tls\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.021025 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.020992    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrd6p\" (UniqueName: \"kubernetes.io/projected/3a769970-95dd-411f-8b0c-1bf49dc80aae-kube-api-access-vrd6p\") pod \"maas-api-e2e-migrate-3a585460-698d4d5869-q77hj\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.043279 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.043226    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:53.198661 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.198616    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"]
Jul 29 01:42:53.202393 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:42:53.202356    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a769970_95dd_411f_8b0c_1bf49dc80aae.slice/crio-83cc99685831b7d424b89a0d114aa90685fc8dba5fd50612d901e624f0b23ddd WatchSource:0}: Error finding container 83cc99685831b7d424b89a0d114aa90685fc8dba5fd50612d901e624f0b23ddd: Status 404 returned error can't find the container with id 83cc99685831b7d424b89a0d114aa90685fc8dba5fd50612d901e624f0b23ddd
Jul 29 01:42:53.204071 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.204038    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:42:53.403981 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.403934    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"]
Jul 29 01:42:53.408918 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.408879    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.415400 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.415373    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-3a585460-dockercfg-ldc9v\""
Jul 29 01:42:53.415524 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.415373    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-3a585460\""
Jul 29 01:42:53.425590 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.425546    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"]
Jul 29 01:42:53.429105 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.429064    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"]
Jul 29 01:42:53.429331 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.429201    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.445641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.445604    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"]
Jul 29 01:42:53.516750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.516706    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb71891e-383b-41d9-9baa-bc75109a171f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.516750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.516750    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca86a5e-5205-483d-9f69-0cd822df1924-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") " pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.517047 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.516775    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dhsx\" (UniqueName: \"kubernetes.io/projected/8ca86a5e-5205-483d-9f69-0cd822df1924-kube-api-access-7dhsx\") pod \"payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") " pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.517047 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.516868    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9snp6\" (UniqueName: \"kubernetes.io/projected/bb71891e-383b-41d9-9baa-bc75109a171f-kube-api-access-9snp6\") pod \"payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.617480 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.617423    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb71891e-383b-41d9-9baa-bc75109a171f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.617480 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.617473    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca86a5e-5205-483d-9f69-0cd822df1924-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") " pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.617778 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.617510    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dhsx\" (UniqueName: \"kubernetes.io/projected/8ca86a5e-5205-483d-9f69-0cd822df1924-kube-api-access-7dhsx\") pod \"payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") " pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.617778 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.617568    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9snp6\" (UniqueName: \"kubernetes.io/projected/bb71891e-383b-41d9-9baa-bc75109a171f-kube-api-access-9snp6\") pod \"payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.624722 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.618834    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb71891e-383b-41d9-9baa-bc75109a171f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.624722 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.619040    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca86a5e-5205-483d-9f69-0cd822df1924-plugins-config-volume\") pod \"payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") " pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.633928 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.633888    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dhsx\" (UniqueName: \"kubernetes.io/projected/8ca86a5e-5205-483d-9f69-0cd822df1924-kube-api-access-7dhsx\") pod \"payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") " pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.638397 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.638351    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9snp6\" (UniqueName: \"kubernetes.io/projected/bb71891e-383b-41d9-9baa-bc75109a171f-kube-api-access-9snp6\") pod \"payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.721527 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.721415    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:53.745824 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.745790    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:53.803975 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.803932    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj" event={"ID":"3a769970-95dd-411f-8b0c-1bf49dc80aae","Type":"ContainerStarted","Data":"83cc99685831b7d424b89a0d114aa90685fc8dba5fd50612d901e624f0b23ddd"}
Jul 29 01:42:53.893399 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:53.893361    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"]
Jul 29 01:42:53.895560 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:42:53.895524    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb71891e_383b_41d9_9baa_bc75109a171f.slice/crio-bbeba7485f918a8334d340f4cee6c3c5cfe56fe0ae4f74aa8a481ea210bdbcd3 WatchSource:0}: Error finding container bbeba7485f918a8334d340f4cee6c3c5cfe56fe0ae4f74aa8a481ea210bdbcd3: Status 404 returned error can't find the container with id bbeba7485f918a8334d340f4cee6c3c5cfe56fe0ae4f74aa8a481ea210bdbcd3
Jul 29 01:42:54.143198 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.143157    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"]
Jul 29 01:42:54.145744 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:42:54.145696    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca86a5e_5205_483d_9f69_0cd822df1924.slice/crio-b46a45368d8cbc00062938de1af1eb1fada2765f1ef65ff1e322ab52f480b1e3 WatchSource:0}: Error finding container b46a45368d8cbc00062938de1af1eb1fada2765f1ef65ff1e322ab52f480b1e3: Status 404 returned error can't find the container with id b46a45368d8cbc00062938de1af1eb1fada2765f1ef65ff1e322ab52f480b1e3
Jul 29 01:42:54.812518 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.812474    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk" event={"ID":"8ca86a5e-5205-483d-9f69-0cd822df1924","Type":"ContainerStarted","Data":"10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75"}
Jul 29 01:42:54.813015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.812544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk" event={"ID":"8ca86a5e-5205-483d-9f69-0cd822df1924","Type":"ContainerStarted","Data":"b46a45368d8cbc00062938de1af1eb1fada2765f1ef65ff1e322ab52f480b1e3"}
Jul 29 01:42:54.813015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.812685    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:42:54.814758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.814652    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9" event={"ID":"bb71891e-383b-41d9-9baa-bc75109a171f","Type":"ContainerStarted","Data":"a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f"}
Jul 29 01:42:54.814758 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.814718    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9" event={"ID":"bb71891e-383b-41d9-9baa-bc75109a171f","Type":"ContainerStarted","Data":"bbeba7485f918a8334d340f4cee6c3c5cfe56fe0ae4f74aa8a481ea210bdbcd3"}
Jul 29 01:42:54.815002 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.814796    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:42:54.830996 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.830908    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk" podStartSLOduration=1.830885433 podStartE2EDuration="1.830885433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:54.829763485 +0000 UTC m=+2007.821729154" watchObservedRunningTime="2026-07-29 01:42:54.830885433 +0000 UTC m=+2007.822851102"
Jul 29 01:42:54.848542 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:54.848473    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9" podStartSLOduration=1.848451136 podStartE2EDuration="1.848451136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:54.845785253 +0000 UTC m=+2007.837750919" watchObservedRunningTime="2026-07-29 01:42:54.848451136 +0000 UTC m=+2007.840416805"
Jul 29 01:42:55.823005 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:55.822955    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj" event={"ID":"3a769970-95dd-411f-8b0c-1bf49dc80aae","Type":"ContainerStarted","Data":"b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64"}
Jul 29 01:42:55.823534 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:55.823417    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:42:55.845818 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:42:55.845741    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj" podStartSLOduration=1.9565091909999999 podStartE2EDuration="3.84572142s" totalImagesPullingTime="1.889212229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:55.843346742 +0000 UTC m=+2008.835312412" watchObservedRunningTime="2026-07-29 01:42:55.84572142 +0000 UTC m=+2008.837687088"
Jul 29 01:43:01.835098 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:43:01.835061    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:43:05.826100 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:43:05.826057    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:43:05.826554 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:43:05.826144    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:47:01.382442 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.382338    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"]
Jul 29 01:47:01.384845 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.382630    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj" podUID="3a769970-95dd-411f-8b0c-1bf49dc80aae" containerName="maas-api" containerID="cri-o://b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64" gracePeriod=30
Jul 29 01:47:01.429294 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.429225    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"]
Jul 29 01:47:01.429636 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.429567    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk" podUID="8ca86a5e-5205-483d-9f69-0cd822df1924" containerName="payload-processing" containerID="cri-o://10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75" gracePeriod=30
Jul 29 01:47:01.435885 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.435771    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"]
Jul 29 01:47:01.437085 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.436478    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9" podUID="bb71891e-383b-41d9-9baa-bc75109a171f" containerName="payload-pre-processing" containerID="cri-o://a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f" gracePeriod=30
Jul 29 01:47:01.725637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.725600    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:47:01.754160 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.754117    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:47:01.768538 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.768495    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:47:01.827324 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827242    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca86a5e-5205-483d-9f69-0cd822df1924-plugins-config-volume\") pod \"8ca86a5e-5205-483d-9f69-0cd822df1924\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") "
Jul 29 01:47:01.827536 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827350    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a769970-95dd-411f-8b0c-1bf49dc80aae-maas-api-tls\") pod \"3a769970-95dd-411f-8b0c-1bf49dc80aae\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") "
Jul 29 01:47:01.827536 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827387    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9snp6\" (UniqueName: \"kubernetes.io/projected/bb71891e-383b-41d9-9baa-bc75109a171f-kube-api-access-9snp6\") pod \"bb71891e-383b-41d9-9baa-bc75109a171f\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") "
Jul 29 01:47:01.827536 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827422    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a769970-95dd-411f-8b0c-1bf49dc80aae-openshift-service-ca\") pod \"3a769970-95dd-411f-8b0c-1bf49dc80aae\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") "
Jul 29 01:47:01.827536 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827517    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrd6p\" (UniqueName: \"kubernetes.io/projected/3a769970-95dd-411f-8b0c-1bf49dc80aae-kube-api-access-vrd6p\") pod \"3a769970-95dd-411f-8b0c-1bf49dc80aae\" (UID: \"3a769970-95dd-411f-8b0c-1bf49dc80aae\") "
Jul 29 01:47:01.827886 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827553    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dhsx\" (UniqueName: \"kubernetes.io/projected/8ca86a5e-5205-483d-9f69-0cd822df1924-kube-api-access-7dhsx\") pod \"8ca86a5e-5205-483d-9f69-0cd822df1924\" (UID: \"8ca86a5e-5205-483d-9f69-0cd822df1924\") "
Jul 29 01:47:01.827886 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827584    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb71891e-383b-41d9-9baa-bc75109a171f-plugins-config-volume\") pod \"bb71891e-383b-41d9-9baa-bc75109a171f\" (UID: \"bb71891e-383b-41d9-9baa-bc75109a171f\") "
Jul 29 01:47:01.827886 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827789    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ca86a5e-5205-483d-9f69-0cd822df1924-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ca86a5e-5205-483d-9f69-0cd822df1924" (UID: "8ca86a5e-5205-483d-9f69-0cd822df1924"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:01.828105 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.827942    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca86a5e-5205-483d-9f69-0cd822df1924-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:01.828215 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.828183    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a769970-95dd-411f-8b0c-1bf49dc80aae-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a769970-95dd-411f-8b0c-1bf49dc80aae" (UID: "3a769970-95dd-411f-8b0c-1bf49dc80aae"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:01.828307 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.828188    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb71891e-383b-41d9-9baa-bc75109a171f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bb71891e-383b-41d9-9baa-bc75109a171f" (UID: "bb71891e-383b-41d9-9baa-bc75109a171f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:47:01.830184 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.830136    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a769970-95dd-411f-8b0c-1bf49dc80aae-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a769970-95dd-411f-8b0c-1bf49dc80aae" (UID: "3a769970-95dd-411f-8b0c-1bf49dc80aae"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:47:01.830409 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.830387    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a769970-95dd-411f-8b0c-1bf49dc80aae-kube-api-access-vrd6p" (OuterVolumeSpecName: "kube-api-access-vrd6p") pod "3a769970-95dd-411f-8b0c-1bf49dc80aae" (UID: "3a769970-95dd-411f-8b0c-1bf49dc80aae"). InnerVolumeSpecName "kube-api-access-vrd6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:01.830463 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.830408    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb71891e-383b-41d9-9baa-bc75109a171f-kube-api-access-9snp6" (OuterVolumeSpecName: "kube-api-access-9snp6") pod "bb71891e-383b-41d9-9baa-bc75109a171f" (UID: "bb71891e-383b-41d9-9baa-bc75109a171f"). InnerVolumeSpecName "kube-api-access-9snp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:01.830507 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.830460    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ca86a5e-5205-483d-9f69-0cd822df1924-kube-api-access-7dhsx" (OuterVolumeSpecName: "kube-api-access-7dhsx") pod "8ca86a5e-5205-483d-9f69-0cd822df1924" (UID: "8ca86a5e-5205-483d-9f69-0cd822df1924"). InnerVolumeSpecName "kube-api-access-7dhsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:47:01.928684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.928576    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a769970-95dd-411f-8b0c-1bf49dc80aae-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:01.928684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.928616    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9snp6\" (UniqueName: \"kubernetes.io/projected/bb71891e-383b-41d9-9baa-bc75109a171f-kube-api-access-9snp6\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:01.928684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.928625    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a769970-95dd-411f-8b0c-1bf49dc80aae-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:01.928684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.928636    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrd6p\" (UniqueName: \"kubernetes.io/projected/3a769970-95dd-411f-8b0c-1bf49dc80aae-kube-api-access-vrd6p\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:01.928684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.928645    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dhsx\" (UniqueName: \"kubernetes.io/projected/8ca86a5e-5205-483d-9f69-0cd822df1924-kube-api-access-7dhsx\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:01.928684 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:01.928653    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bb71891e-383b-41d9-9baa-bc75109a171f-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:47:02.128918 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.128873    2557 generic.go:356] "Generic (PLEG): container finished" podID="8ca86a5e-5205-483d-9f69-0cd822df1924" containerID="10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75" exitCode=0
Jul 29 01:47:02.128918 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.128927    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"
Jul 29 01:47:02.129171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.128969    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk" event={"ID":"8ca86a5e-5205-483d-9f69-0cd822df1924","Type":"ContainerDied","Data":"10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75"}
Jul 29 01:47:02.129171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.129036    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk" event={"ID":"8ca86a5e-5205-483d-9f69-0cd822df1924","Type":"ContainerDied","Data":"b46a45368d8cbc00062938de1af1eb1fada2765f1ef65ff1e322ab52f480b1e3"}
Jul 29 01:47:02.129171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.129062    2557 scope.go:117] "RemoveContainer" containerID="10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75"
Jul 29 01:47:02.130663 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.130627    2557 generic.go:356] "Generic (PLEG): container finished" podID="3a769970-95dd-411f-8b0c-1bf49dc80aae" containerID="b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64" exitCode=0
Jul 29 01:47:02.130814 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.130689    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"
Jul 29 01:47:02.130814 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.130705    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj" event={"ID":"3a769970-95dd-411f-8b0c-1bf49dc80aae","Type":"ContainerDied","Data":"b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64"}
Jul 29 01:47:02.130814 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.130766    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj" event={"ID":"3a769970-95dd-411f-8b0c-1bf49dc80aae","Type":"ContainerDied","Data":"83cc99685831b7d424b89a0d114aa90685fc8dba5fd50612d901e624f0b23ddd"}
Jul 29 01:47:02.132432 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.132384    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb71891e-383b-41d9-9baa-bc75109a171f" containerID="a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f" exitCode=0
Jul 29 01:47:02.132432 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.132433    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"
Jul 29 01:47:02.132757 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.132461    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9" event={"ID":"bb71891e-383b-41d9-9baa-bc75109a171f","Type":"ContainerDied","Data":"a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f"}
Jul 29 01:47:02.132757 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.132513    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9" event={"ID":"bb71891e-383b-41d9-9baa-bc75109a171f","Type":"ContainerDied","Data":"bbeba7485f918a8334d340f4cee6c3c5cfe56fe0ae4f74aa8a481ea210bdbcd3"}
Jul 29 01:47:02.139926 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.139896    2557 scope.go:117] "RemoveContainer" containerID="10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75"
Jul 29 01:47:02.140454 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:47:02.140419    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75\": container with ID starting with 10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75 not found: ID does not exist" containerID="10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75"
Jul 29 01:47:02.140606 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.140472    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75"} err="failed to get container status \"10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75\": rpc error: code = NotFound desc = could not find container \"10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75\": container with ID starting with 10b720019973c0c4b5e9378cf4fbd0edbbd52af27aeb271708dc1e5449286f75 not found: ID does not exist"
Jul 29 01:47:02.140606 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.140498    2557 scope.go:117] "RemoveContainer" containerID="b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64"
Jul 29 01:47:02.151699 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.151675    2557 scope.go:117] "RemoveContainer" containerID="b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64"
Jul 29 01:47:02.152051 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:47:02.152026    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64\": container with ID starting with b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64 not found: ID does not exist" containerID="b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64"
Jul 29 01:47:02.152098 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.152064    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64"} err="failed to get container status \"b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64\": rpc error: code = NotFound desc = could not find container \"b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64\": container with ID starting with b8277b275a60f3e3e669940c7c08b5977a9303219125a7ca47c0ffdd30e54f64 not found: ID does not exist"
Jul 29 01:47:02.152098 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.152085    2557 scope.go:117] "RemoveContainer" containerID="a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f"
Jul 29 01:47:02.163965 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.162372    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"]
Jul 29 01:47:02.164404 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.164189    2557 scope.go:117] "RemoveContainer" containerID="a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f"
Jul 29 01:47:02.165371 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:47:02.165336    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f\": container with ID starting with a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f not found: ID does not exist" containerID="a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f"
Jul 29 01:47:02.165534 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.165378    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f"} err="failed to get container status \"a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f\": rpc error: code = NotFound desc = could not find container \"a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f\": container with ID starting with a5e55cd065e0baea5f63682abf2f39aa492e64035b3a3728d36e947b08891f9f not found: ID does not exist"
Jul 29 01:47:02.166810 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.166778    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-3a585460-698d4d5869-q77hj"]
Jul 29 01:47:02.178892 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.178781    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"]
Jul 29 01:47:02.183050 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.183006    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-3a585460-5fbd9646fb-lkws9"]
Jul 29 01:47:02.193621 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.193570    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"]
Jul 29 01:47:02.199226 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:02.199186    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-3a585460-5f7c7c5fcc-ns4fk"]
Jul 29 01:47:03.524706 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:03.524657    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a769970-95dd-411f-8b0c-1bf49dc80aae" path="/var/lib/kubelet/pods/3a769970-95dd-411f-8b0c-1bf49dc80aae/volumes"
Jul 29 01:47:03.525233 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:03.525043    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ca86a5e-5205-483d-9f69-0cd822df1924" path="/var/lib/kubelet/pods/8ca86a5e-5205-483d-9f69-0cd822df1924/volumes"
Jul 29 01:47:03.525441 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:03.525425    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb71891e-383b-41d9-9baa-bc75109a171f" path="/var/lib/kubelet/pods/bb71891e-383b-41d9-9baa-bc75109a171f/volumes"
Jul 29 01:47:05.067755 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.067710    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"]
Jul 29 01:47:05.068179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068129    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a769970-95dd-411f-8b0c-1bf49dc80aae" containerName="maas-api"
Jul 29 01:47:05.068179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068141    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a769970-95dd-411f-8b0c-1bf49dc80aae" containerName="maas-api"
Jul 29 01:47:05.068179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068159    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb71891e-383b-41d9-9baa-bc75109a171f" containerName="payload-pre-processing"
Jul 29 01:47:05.068179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068167    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb71891e-383b-41d9-9baa-bc75109a171f" containerName="payload-pre-processing"
Jul 29 01:47:05.068179 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068181    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ca86a5e-5205-483d-9f69-0cd822df1924" containerName="payload-processing"
Jul 29 01:47:05.068390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068188    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ca86a5e-5205-483d-9f69-0cd822df1924" containerName="payload-processing"
Jul 29 01:47:05.068390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068240    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ca86a5e-5205-483d-9f69-0cd822df1924" containerName="payload-processing"
Jul 29 01:47:05.068390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068248    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb71891e-383b-41d9-9baa-bc75109a171f" containerName="payload-pre-processing"
Jul 29 01:47:05.068390 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.068288    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a769970-95dd-411f-8b0c-1bf49dc80aae" containerName="maas-api"
Jul 29 01:47:05.072482 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.072454    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.075742 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.075707    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-000a4d6e-serving-cert\""
Jul 29 01:47:05.076023 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.075708    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7b9zw\""
Jul 29 01:47:05.085297 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.085226    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"]
Jul 29 01:47:05.157752 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.157704    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7ec92e-cf99-449c-a55c-e8b3914f3967-openshift-service-ca\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.157752 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.157747    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7ec92e-cf99-449c-a55c-e8b3914f3967-maas-api-tls\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.157980 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.157858    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7vw\" (UniqueName: \"kubernetes.io/projected/bb7ec92e-cf99-449c-a55c-e8b3914f3967-kube-api-access-9t7vw\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.259075 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.259033    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7vw\" (UniqueName: \"kubernetes.io/projected/bb7ec92e-cf99-449c-a55c-e8b3914f3967-kube-api-access-9t7vw\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.259325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.259107    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7ec92e-cf99-449c-a55c-e8b3914f3967-openshift-service-ca\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.259325 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.259134    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7ec92e-cf99-449c-a55c-e8b3914f3967-maas-api-tls\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.259809 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.259784    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7ec92e-cf99-449c-a55c-e8b3914f3967-openshift-service-ca\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.261799 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.261774    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7ec92e-cf99-449c-a55c-e8b3914f3967-maas-api-tls\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.274112 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.274067    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7vw\" (UniqueName: \"kubernetes.io/projected/bb7ec92e-cf99-449c-a55c-e8b3914f3967-kube-api-access-9t7vw\") pod \"maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.385036 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.384994    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:05.550040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.550003    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"]
Jul 29 01:47:05.554543 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:47:05.554504    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7ec92e_cf99_449c_a55c_e8b3914f3967.slice/crio-80c78702861fffca95340b0134fd3517711d0738705cd4309c3f5ca654a555ea WatchSource:0}: Error finding container 80c78702861fffca95340b0134fd3517711d0738705cd4309c3f5ca654a555ea: Status 404 returned error can't find the container with id 80c78702861fffca95340b0134fd3517711d0738705cd4309c3f5ca654a555ea
Jul 29 01:47:05.861637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.861584    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"]
Jul 29 01:47:05.866417 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.866391    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:05.870120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.870080    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-000a4d6e-dockercfg-sfnqk\""
Jul 29 01:47:05.870429 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.870407    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-000a4d6e\""
Jul 29 01:47:05.871984 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.871958    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"]
Jul 29 01:47:05.875571 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.875545    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:05.878642 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.878604    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"]
Jul 29 01:47:05.891144 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.891094    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"]
Jul 29 01:47:05.966924 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.966878    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rfnq\" (UniqueName: \"kubernetes.io/projected/08dc7285-df01-4286-b303-00a97b9a1030-kube-api-access-7rfnq\") pod \"payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") " pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:05.967120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.966948    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-479bq\" (UniqueName: \"kubernetes.io/projected/ed69545a-02f3-4826-87e6-6337e7cfa617-kube-api-access-479bq\") pod \"payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:05.967120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.966974    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed69545a-02f3-4826-87e6-6337e7cfa617-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:05.967120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:05.967002    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08dc7285-df01-4286-b303-00a97b9a1030-plugins-config-volume\") pod \"payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") " pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:06.068136 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.068072    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfnq\" (UniqueName: \"kubernetes.io/projected/08dc7285-df01-4286-b303-00a97b9a1030-kube-api-access-7rfnq\") pod \"payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") " pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:06.068659 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.068171    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-479bq\" (UniqueName: \"kubernetes.io/projected/ed69545a-02f3-4826-87e6-6337e7cfa617-kube-api-access-479bq\") pod \"payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:06.068659 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.068211    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed69545a-02f3-4826-87e6-6337e7cfa617-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:06.068659 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.068278    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08dc7285-df01-4286-b303-00a97b9a1030-plugins-config-volume\") pod \"payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") " pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:06.069043 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.069015    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed69545a-02f3-4826-87e6-6337e7cfa617-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:06.069211 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.069188    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08dc7285-df01-4286-b303-00a97b9a1030-plugins-config-volume\") pod \"payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") " pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:06.077020 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.076980    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rfnq\" (UniqueName: \"kubernetes.io/projected/08dc7285-df01-4286-b303-00a97b9a1030-kube-api-access-7rfnq\") pod \"payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") " pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:06.077185 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.077120    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-479bq\" (UniqueName: \"kubernetes.io/projected/ed69545a-02f3-4826-87e6-6337e7cfa617-kube-api-access-479bq\") pod \"payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:06.158378 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.158280    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq" event={"ID":"bb7ec92e-cf99-449c-a55c-e8b3914f3967","Type":"ContainerStarted","Data":"80c78702861fffca95340b0134fd3517711d0738705cd4309c3f5ca654a555ea"}
Jul 29 01:47:06.179749 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.179704    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:06.193177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.193150    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:06.345982 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.345944    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"]
Jul 29 01:47:06.349747 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:47:06.349709    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded69545a_02f3_4826_87e6_6337e7cfa617.slice/crio-91c97b1329c232f615f15da8804f07ddc156aff1a4974aac74df4997e6e50512 WatchSource:0}: Error finding container 91c97b1329c232f615f15da8804f07ddc156aff1a4974aac74df4997e6e50512: Status 404 returned error can't find the container with id 91c97b1329c232f615f15da8804f07ddc156aff1a4974aac74df4997e6e50512
Jul 29 01:47:06.372605 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:06.372564    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"]
Jul 29 01:47:06.376638 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:47:06.376593    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08dc7285_df01_4286_b303_00a97b9a1030.slice/crio-69913dd338994e86f56052ed5b4056e764e68c8278b1ae29676221e0bc0aeb4b WatchSource:0}: Error finding container 69913dd338994e86f56052ed5b4056e764e68c8278b1ae29676221e0bc0aeb4b: Status 404 returned error can't find the container with id 69913dd338994e86f56052ed5b4056e764e68c8278b1ae29676221e0bc0aeb4b
Jul 29 01:47:07.165707 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.165667    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq" event={"ID":"08dc7285-df01-4286-b303-00a97b9a1030","Type":"ContainerStarted","Data":"4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443"}
Jul 29 01:47:07.166322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.165737    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq" event={"ID":"08dc7285-df01-4286-b303-00a97b9a1030","Type":"ContainerStarted","Data":"69913dd338994e86f56052ed5b4056e764e68c8278b1ae29676221e0bc0aeb4b"}
Jul 29 01:47:07.166322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.165775    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:07.167580 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.167547    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq" event={"ID":"bb7ec92e-cf99-449c-a55c-e8b3914f3967","Type":"ContainerStarted","Data":"a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7"}
Jul 29 01:47:07.167737 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.167614    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:07.169382 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.169342    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh" event={"ID":"ed69545a-02f3-4826-87e6-6337e7cfa617","Type":"ContainerStarted","Data":"d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d"}
Jul 29 01:47:07.169546 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.169414    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh" event={"ID":"ed69545a-02f3-4826-87e6-6337e7cfa617","Type":"ContainerStarted","Data":"91c97b1329c232f615f15da8804f07ddc156aff1a4974aac74df4997e6e50512"}
Jul 29 01:47:07.169546 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.169446    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:47:07.188664 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.188595    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq" podStartSLOduration=2.188575642 podStartE2EDuration="2.188575642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:07.187304761 +0000 UTC m=+2260.179270431" watchObservedRunningTime="2026-07-29 01:47:07.188575642 +0000 UTC m=+2260.180541310"
Jul 29 01:47:07.205830 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.205769    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq" podStartSLOduration=0.928820333 podStartE2EDuration="2.205746955s" totalImagesPullingTime="1.276926622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:07.205090405 +0000 UTC m=+2260.197056074" watchObservedRunningTime="2026-07-29 01:47:07.205746955 +0000 UTC m=+2260.197712623"
Jul 29 01:47:07.225750 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:07.225681    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh" podStartSLOduration=2.225660937 podStartE2EDuration="2.225660937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:07.22411041 +0000 UTC m=+2260.216076081" watchObservedRunningTime="2026-07-29 01:47:07.225660937 +0000 UTC m=+2260.217626605"
Jul 29 01:47:13.180299 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:13.180268    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:47:18.176932 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:18.176896    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:47:18.177375 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:47:18.176992    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:50:19.333729 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.333686    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"]
Jul 29 01:50:19.334393 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.333971    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq" podUID="bb7ec92e-cf99-449c-a55c-e8b3914f3967" containerName="maas-api" containerID="cri-o://a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7" gracePeriod=30
Jul 29 01:50:19.385036 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.384987    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"]
Jul 29 01:50:19.385425 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.385388    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq" podUID="08dc7285-df01-4286-b303-00a97b9a1030" containerName="payload-processing" containerID="cri-o://4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443" gracePeriod=30
Jul 29 01:50:19.395025 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.394978    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"]
Jul 29 01:50:19.395305 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.395272    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh" podUID="ed69545a-02f3-4826-87e6-6337e7cfa617" containerName="payload-pre-processing" containerID="cri-o://d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d" gracePeriod=30
Jul 29 01:50:19.661481 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.661440    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:50:19.713042 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.713012    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:50:19.719520 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.719488    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rfnq\" (UniqueName: \"kubernetes.io/projected/08dc7285-df01-4286-b303-00a97b9a1030-kube-api-access-7rfnq\") pod \"08dc7285-df01-4286-b303-00a97b9a1030\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") "
Jul 29 01:50:19.719727 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.719576    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08dc7285-df01-4286-b303-00a97b9a1030-plugins-config-volume\") pod \"08dc7285-df01-4286-b303-00a97b9a1030\" (UID: \"08dc7285-df01-4286-b303-00a97b9a1030\") "
Jul 29 01:50:19.719727 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.719618    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t7vw\" (UniqueName: \"kubernetes.io/projected/bb7ec92e-cf99-449c-a55c-e8b3914f3967-kube-api-access-9t7vw\") pod \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") "
Jul 29 01:50:19.719727 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.719655    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7ec92e-cf99-449c-a55c-e8b3914f3967-maas-api-tls\") pod \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") "
Jul 29 01:50:19.719727 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.719715    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7ec92e-cf99-449c-a55c-e8b3914f3967-openshift-service-ca\") pod \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\" (UID: \"bb7ec92e-cf99-449c-a55c-e8b3914f3967\") "
Jul 29 01:50:19.720107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.719999    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08dc7285-df01-4286-b303-00a97b9a1030-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08dc7285-df01-4286-b303-00a97b9a1030" (UID: "08dc7285-df01-4286-b303-00a97b9a1030"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:50:19.720416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.720380    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb7ec92e-cf99-449c-a55c-e8b3914f3967-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb7ec92e-cf99-449c-a55c-e8b3914f3967" (UID: "bb7ec92e-cf99-449c-a55c-e8b3914f3967"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:50:19.722196 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.722158    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb7ec92e-cf99-449c-a55c-e8b3914f3967-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb7ec92e-cf99-449c-a55c-e8b3914f3967" (UID: "bb7ec92e-cf99-449c-a55c-e8b3914f3967"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:50:19.722358 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.722331    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08dc7285-df01-4286-b303-00a97b9a1030-kube-api-access-7rfnq" (OuterVolumeSpecName: "kube-api-access-7rfnq") pod "08dc7285-df01-4286-b303-00a97b9a1030" (UID: "08dc7285-df01-4286-b303-00a97b9a1030"). InnerVolumeSpecName "kube-api-access-7rfnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:19.722358 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.722337    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb7ec92e-cf99-449c-a55c-e8b3914f3967-kube-api-access-9t7vw" (OuterVolumeSpecName: "kube-api-access-9t7vw") pod "bb7ec92e-cf99-449c-a55c-e8b3914f3967" (UID: "bb7ec92e-cf99-449c-a55c-e8b3914f3967"). InnerVolumeSpecName "kube-api-access-9t7vw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:19.723163 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.723135    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:50:19.820911 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.820866    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-479bq\" (UniqueName: \"kubernetes.io/projected/ed69545a-02f3-4826-87e6-6337e7cfa617-kube-api-access-479bq\") pod \"ed69545a-02f3-4826-87e6-6337e7cfa617\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") "
Jul 29 01:50:19.821097 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.820956    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed69545a-02f3-4826-87e6-6337e7cfa617-plugins-config-volume\") pod \"ed69545a-02f3-4826-87e6-6337e7cfa617\" (UID: \"ed69545a-02f3-4826-87e6-6337e7cfa617\") "
Jul 29 01:50:19.821146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.821114    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rfnq\" (UniqueName: \"kubernetes.io/projected/08dc7285-df01-4286-b303-00a97b9a1030-kube-api-access-7rfnq\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:19.821146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.821125    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08dc7285-df01-4286-b303-00a97b9a1030-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:19.821146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.821137    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t7vw\" (UniqueName: \"kubernetes.io/projected/bb7ec92e-cf99-449c-a55c-e8b3914f3967-kube-api-access-9t7vw\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:19.821238 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.821147    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb7ec92e-cf99-449c-a55c-e8b3914f3967-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:19.821238 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.821156    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb7ec92e-cf99-449c-a55c-e8b3914f3967-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:19.821413 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.821388    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed69545a-02f3-4826-87e6-6337e7cfa617-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed69545a-02f3-4826-87e6-6337e7cfa617" (UID: "ed69545a-02f3-4826-87e6-6337e7cfa617"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:50:19.823177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.823142    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed69545a-02f3-4826-87e6-6337e7cfa617-kube-api-access-479bq" (OuterVolumeSpecName: "kube-api-access-479bq") pod "ed69545a-02f3-4826-87e6-6337e7cfa617" (UID: "ed69545a-02f3-4826-87e6-6337e7cfa617"). InnerVolumeSpecName "kube-api-access-479bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:19.922336 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.922253    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-479bq\" (UniqueName: \"kubernetes.io/projected/ed69545a-02f3-4826-87e6-6337e7cfa617-kube-api-access-479bq\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:19.922336 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:19.922330    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed69545a-02f3-4826-87e6-6337e7cfa617-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.114766 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.114726    2557 generic.go:356] "Generic (PLEG): container finished" podID="08dc7285-df01-4286-b303-00a97b9a1030" containerID="4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443" exitCode=0
Jul 29 01:50:20.114970 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.114783    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"
Jul 29 01:50:20.114970 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.114804    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq" event={"ID":"08dc7285-df01-4286-b303-00a97b9a1030","Type":"ContainerDied","Data":"4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443"}
Jul 29 01:50:20.114970 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.114862    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq" event={"ID":"08dc7285-df01-4286-b303-00a97b9a1030","Type":"ContainerDied","Data":"69913dd338994e86f56052ed5b4056e764e68c8278b1ae29676221e0bc0aeb4b"}
Jul 29 01:50:20.114970 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.114887    2557 scope.go:117] "RemoveContainer" containerID="4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443"
Jul 29 01:50:20.116635 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.116604    2557 generic.go:356] "Generic (PLEG): container finished" podID="bb7ec92e-cf99-449c-a55c-e8b3914f3967" containerID="a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7" exitCode=0
Jul 29 01:50:20.116801 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.116672    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"
Jul 29 01:50:20.116801 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.116687    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq" event={"ID":"bb7ec92e-cf99-449c-a55c-e8b3914f3967","Type":"ContainerDied","Data":"a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7"}
Jul 29 01:50:20.116801 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.116769    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq" event={"ID":"bb7ec92e-cf99-449c-a55c-e8b3914f3967","Type":"ContainerDied","Data":"80c78702861fffca95340b0134fd3517711d0738705cd4309c3f5ca654a555ea"}
Jul 29 01:50:20.118518 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.118469    2557 generic.go:356] "Generic (PLEG): container finished" podID="ed69545a-02f3-4826-87e6-6337e7cfa617" containerID="d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d" exitCode=0
Jul 29 01:50:20.118680 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.118529    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"
Jul 29 01:50:20.118680 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.118544    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh" event={"ID":"ed69545a-02f3-4826-87e6-6337e7cfa617","Type":"ContainerDied","Data":"d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d"}
Jul 29 01:50:20.118680 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.118596    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh" event={"ID":"ed69545a-02f3-4826-87e6-6337e7cfa617","Type":"ContainerDied","Data":"91c97b1329c232f615f15da8804f07ddc156aff1a4974aac74df4997e6e50512"}
Jul 29 01:50:20.129145 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.128989    2557 scope.go:117] "RemoveContainer" containerID="4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443"
Jul 29 01:50:20.130178 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:50:20.130131    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443\": container with ID starting with 4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443 not found: ID does not exist" containerID="4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443"
Jul 29 01:50:20.130363 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.130198    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443"} err="failed to get container status \"4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443\": rpc error: code = NotFound desc = could not find container \"4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443\": container with ID starting with 4308f24501f845d45377e0e5bb374a818c37aac4eeb0c05aefd0a5ee1456f443 not found: ID does not exist"
Jul 29 01:50:20.130363 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.130226    2557 scope.go:117] "RemoveContainer" containerID="a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7"
Jul 29 01:50:20.140364 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.140338    2557 scope.go:117] "RemoveContainer" containerID="a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7"
Jul 29 01:50:20.140803 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:50:20.140779    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7\": container with ID starting with a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7 not found: ID does not exist" containerID="a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7"
Jul 29 01:50:20.140861 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.140815    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7"} err="failed to get container status \"a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7\": rpc error: code = NotFound desc = could not find container \"a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7\": container with ID starting with a91375f63637d2482adab9ccfebb00bdf2f7e45cb293cdf63367ef74eb5502f7 not found: ID does not exist"
Jul 29 01:50:20.140861 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.140837    2557 scope.go:117] "RemoveContainer" containerID="d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d"
Jul 29 01:50:20.149467 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.149418    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"]
Jul 29 01:50:20.150420 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.150399    2557 scope.go:117] "RemoveContainer" containerID="d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d"
Jul 29 01:50:20.150814 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:50:20.150788    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d\": container with ID starting with d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d not found: ID does not exist" containerID="d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d"
Jul 29 01:50:20.150875 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.150823    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d"} err="failed to get container status \"d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d\": rpc error: code = NotFound desc = could not find container \"d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d\": container with ID starting with d8b82700fccf905a5be71803bcd2f5fbf81ab21e0c498e084fba888a3a304e6d not found: ID does not exist"
Jul 29 01:50:20.155848 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.155802    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-000a4d6e-b8f8d88c6-5l6qq"]
Jul 29 01:50:20.168502 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.168455    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"]
Jul 29 01:50:20.174618 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.174522    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-000a4d6e-f78d47764-5pcdh"]
Jul 29 01:50:20.186081 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.186038    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"]
Jul 29 01:50:20.190530 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:20.190485    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-000a4d6e-5f4bd845fd-tchgq"]
Jul 29 01:50:21.523869 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:21.523812    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08dc7285-df01-4286-b303-00a97b9a1030" path="/var/lib/kubelet/pods/08dc7285-df01-4286-b303-00a97b9a1030/volumes"
Jul 29 01:50:21.524490 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:21.524465    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb7ec92e-cf99-449c-a55c-e8b3914f3967" path="/var/lib/kubelet/pods/bb7ec92e-cf99-449c-a55c-e8b3914f3967/volumes"
Jul 29 01:50:21.525042 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:21.525004    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed69545a-02f3-4826-87e6-6337e7cfa617" path="/var/lib/kubelet/pods/ed69545a-02f3-4826-87e6-6337e7cfa617/volumes"
Jul 29 01:50:23.236319 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236276    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"]
Jul 29 01:50:23.236710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236658    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed69545a-02f3-4826-87e6-6337e7cfa617" containerName="payload-pre-processing"
Jul 29 01:50:23.236710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236671    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed69545a-02f3-4826-87e6-6337e7cfa617" containerName="payload-pre-processing"
Jul 29 01:50:23.236710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236678    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08dc7285-df01-4286-b303-00a97b9a1030" containerName="payload-processing"
Jul 29 01:50:23.236710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236683    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="08dc7285-df01-4286-b303-00a97b9a1030" containerName="payload-processing"
Jul 29 01:50:23.236710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236699    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb7ec92e-cf99-449c-a55c-e8b3914f3967" containerName="maas-api"
Jul 29 01:50:23.236710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236707    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb7ec92e-cf99-449c-a55c-e8b3914f3967" containerName="maas-api"
Jul 29 01:50:23.236961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236767    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed69545a-02f3-4826-87e6-6337e7cfa617" containerName="payload-pre-processing"
Jul 29 01:50:23.236961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236778    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="08dc7285-df01-4286-b303-00a97b9a1030" containerName="payload-processing"
Jul 29 01:50:23.236961 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.236785    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb7ec92e-cf99-449c-a55c-e8b3914f3967" containerName="maas-api"
Jul 29 01:50:23.241813 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.241784    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.245393 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.245359    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-74571164-serving-cert\""
Jul 29 01:50:23.245393 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.245385    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7b9zw\""
Jul 29 01:50:23.253957 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.253920    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-maas-api-tls\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.254164 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.253975    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-openshift-service-ca\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.254164 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.254008    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rst66\" (UniqueName: \"kubernetes.io/projected/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-kube-api-access-rst66\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.263870 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.263824    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"]
Jul 29 01:50:23.354852 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.354804    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-maas-api-tls\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.354852 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.354855    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-openshift-service-ca\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.355127 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.354878    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rst66\" (UniqueName: \"kubernetes.io/projected/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-kube-api-access-rst66\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.355713 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.355683    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-openshift-service-ca\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.357463 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.357426    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-maas-api-tls\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.373424 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.373377    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rst66\" (UniqueName: \"kubernetes.io/projected/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-kube-api-access-rst66\") pod \"maas-api-e2e-derive-74571164-7d44cbc78-nj87x\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.553712 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.553611    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:23.710914 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.710872    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"]
Jul 29 01:50:23.714232 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:50:23.714195    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ade9fc6_cfe7_40a3_a91c_803e4005ad8b.slice/crio-e3ceaf4461f47e27439054686bceb3c4934faf1488ae0e6f16ea9037b54e3381 WatchSource:0}: Error finding container e3ceaf4461f47e27439054686bceb3c4934faf1488ae0e6f16ea9037b54e3381: Status 404 returned error can't find the container with id e3ceaf4461f47e27439054686bceb3c4934faf1488ae0e6f16ea9037b54e3381
Jul 29 01:50:23.715742 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:23.715710    2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:50:24.046908 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.046864    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"]
Jul 29 01:50:24.051728 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.051697    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.054734 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.054701    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-74571164\""
Jul 29 01:50:24.055109 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.055086    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-74571164-dockercfg-478tx\""
Jul 29 01:50:24.067892 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.067846    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"]
Jul 29 01:50:24.103725 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.103694    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"]
Jul 29 01:50:24.107468 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.107440    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.128119 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.128074    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"]
Jul 29 01:50:24.146027 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.145985    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x" event={"ID":"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b","Type":"ContainerStarted","Data":"e3ceaf4461f47e27439054686bceb3c4934faf1488ae0e6f16ea9037b54e3381"}
Jul 29 01:50:24.163551 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.163510    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbae4b1-33f6-4adc-929c-d8f4d058667d-plugins-config-volume\") pod \"payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") " pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.163747 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.163562    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7135e761-acbf-455e-9654-4442c14a979b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.163833 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.163737    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tww7m\" (UniqueName: \"kubernetes.io/projected/7135e761-acbf-455e-9654-4442c14a979b-kube-api-access-tww7m\") pod \"payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.163833 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.163789    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsqkf\" (UniqueName: \"kubernetes.io/projected/8bbae4b1-33f6-4adc-929c-d8f4d058667d-kube-api-access-zsqkf\") pod \"payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") " pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.265104 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.265045    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tww7m\" (UniqueName: \"kubernetes.io/projected/7135e761-acbf-455e-9654-4442c14a979b-kube-api-access-tww7m\") pod \"payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.265104 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.265100    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsqkf\" (UniqueName: \"kubernetes.io/projected/8bbae4b1-33f6-4adc-929c-d8f4d058667d-kube-api-access-zsqkf\") pod \"payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") " pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.265997 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.265143    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbae4b1-33f6-4adc-929c-d8f4d058667d-plugins-config-volume\") pod \"payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") " pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.265997 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.265169    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7135e761-acbf-455e-9654-4442c14a979b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.266122 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.266035    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7135e761-acbf-455e-9654-4442c14a979b-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.266202 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.266169    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbae4b1-33f6-4adc-929c-d8f4d058667d-plugins-config-volume\") pod \"payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") " pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.274681 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.274642    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsqkf\" (UniqueName: \"kubernetes.io/projected/8bbae4b1-33f6-4adc-929c-d8f4d058667d-kube-api-access-zsqkf\") pod \"payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") " pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.274834 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.274653    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tww7m\" (UniqueName: \"kubernetes.io/projected/7135e761-acbf-455e-9654-4442c14a979b-kube-api-access-tww7m\") pod \"payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.366177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.366140    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:24.419789 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.419739    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:24.530223 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.530180    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"]
Jul 29 01:50:24.532451 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:50:24.532417    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bbae4b1_33f6_4adc_929c_d8f4d058667d.slice/crio-9d3d526aac8dd9aa24e7dc5fede22367d47284e58a11f754746216650bb2a022 WatchSource:0}: Error finding container 9d3d526aac8dd9aa24e7dc5fede22367d47284e58a11f754746216650bb2a022: Status 404 returned error can't find the container with id 9d3d526aac8dd9aa24e7dc5fede22367d47284e58a11f754746216650bb2a022
Jul 29 01:50:24.599187 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:24.599000    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"]
Jul 29 01:50:24.602122 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:50:24.602086    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7135e761_acbf_455e_9654_4442c14a979b.slice/crio-27040e287c7461c69fce95c41a7fb4fb895ba1b3fa06a19d91d9951355852c61 WatchSource:0}: Error finding container 27040e287c7461c69fce95c41a7fb4fb895ba1b3fa06a19d91d9951355852c61: Status 404 returned error can't find the container with id 27040e287c7461c69fce95c41a7fb4fb895ba1b3fa06a19d91d9951355852c61
Jul 29 01:50:25.153318 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.153251    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x" event={"ID":"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b","Type":"ContainerStarted","Data":"e9756bd42102b199fd25468e37c6e7cf07c4d65d7d064518af84452a357e1ff8"}
Jul 29 01:50:25.153505 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.153342    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:25.155032 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.154998    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd" event={"ID":"8bbae4b1-33f6-4adc-929c-d8f4d058667d","Type":"ContainerStarted","Data":"b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6"}
Jul 29 01:50:25.155192 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.155057    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:50:25.155192 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.155082    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd" event={"ID":"8bbae4b1-33f6-4adc-929c-d8f4d058667d","Type":"ContainerStarted","Data":"9d3d526aac8dd9aa24e7dc5fede22367d47284e58a11f754746216650bb2a022"}
Jul 29 01:50:25.156613 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.156583    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5" event={"ID":"7135e761-acbf-455e-9654-4442c14a979b","Type":"ContainerStarted","Data":"b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542"}
Jul 29 01:50:25.156741 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.156634    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:25.156741 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.156651    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5" event={"ID":"7135e761-acbf-455e-9654-4442c14a979b","Type":"ContainerStarted","Data":"27040e287c7461c69fce95c41a7fb4fb895ba1b3fa06a19d91d9951355852c61"}
Jul 29 01:50:25.174040 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.173981    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x" podStartSLOduration=1.786017089 podStartE2EDuration="2.173964374s" totalImagesPullingTime="387.947285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:50:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:50:25.172194967 +0000 UTC m=+2458.164160634" watchObservedRunningTime="2026-07-29 01:50:25.173964374 +0000 UTC m=+2458.165930041"
Jul 29 01:50:25.192320 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.192237    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5" podStartSLOduration=1.192221844 podStartE2EDuration="1.192221844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:50:25.189941796 +0000 UTC m=+2458.181907467" watchObservedRunningTime="2026-07-29 01:50:25.192221844 +0000 UTC m=+2458.184187512"
Jul 29 01:50:25.211506 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:25.211431    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd" podStartSLOduration=1.211410581 podStartE2EDuration="1.211410581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:50:25.20995692 +0000 UTC m=+2458.201922601" watchObservedRunningTime="2026-07-29 01:50:25.211410581 +0000 UTC m=+2458.203376248"
Jul 29 01:50:31.169883 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:31.169830    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:50:36.165322 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:36.165244    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:50:36.165966 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:50:36.165365    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:52:35.671858 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.671810    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"]
Jul 29 01:52:35.672436 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.672107    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x" podUID="4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" containerName="maas-api" containerID="cri-o://e9756bd42102b199fd25468e37c6e7cf07c4d65d7d064518af84452a357e1ff8" gracePeriod=30
Jul 29 01:52:35.741034 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.740974    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"]
Jul 29 01:52:35.741359 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.741290    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd" podUID="8bbae4b1-33f6-4adc-929c-d8f4d058667d" containerName="payload-processing" containerID="cri-o://b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6" gracePeriod=30
Jul 29 01:52:35.756942 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.756897    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"]
Jul 29 01:52:35.757207 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.757167    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5" podUID="7135e761-acbf-455e-9654-4442c14a979b" containerName="payload-pre-processing" containerID="cri-o://b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542" gracePeriod=30
Jul 29 01:52:35.823554 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.823516    2557 generic.go:356] "Generic (PLEG): container finished" podID="4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" containerID="e9756bd42102b199fd25468e37c6e7cf07c4d65d7d064518af84452a357e1ff8" exitCode=0
Jul 29 01:52:35.823748 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:35.823562    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x" event={"ID":"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b","Type":"ContainerDied","Data":"e9756bd42102b199fd25468e37c6e7cf07c4d65d7d064518af84452a357e1ff8"}
Jul 29 01:52:36.054671 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.054635    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:52:36.063708 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.063664    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:52:36.083025 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.082986    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:52:36.146617 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146572    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-openshift-service-ca\") pod \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") "
Jul 29 01:52:36.146897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146650    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-maas-api-tls\") pod \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") "
Jul 29 01:52:36.146897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146685    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7135e761-acbf-455e-9654-4442c14a979b-plugins-config-volume\") pod \"7135e761-acbf-455e-9654-4442c14a979b\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") "
Jul 29 01:52:36.146897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146704    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsqkf\" (UniqueName: \"kubernetes.io/projected/8bbae4b1-33f6-4adc-929c-d8f4d058667d-kube-api-access-zsqkf\") pod \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") "
Jul 29 01:52:36.146897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146726    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rst66\" (UniqueName: \"kubernetes.io/projected/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-kube-api-access-rst66\") pod \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\" (UID: \"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b\") "
Jul 29 01:52:36.146897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146747    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tww7m\" (UniqueName: \"kubernetes.io/projected/7135e761-acbf-455e-9654-4442c14a979b-kube-api-access-tww7m\") pod \"7135e761-acbf-455e-9654-4442c14a979b\" (UID: \"7135e761-acbf-455e-9654-4442c14a979b\") "
Jul 29 01:52:36.146897 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.146775    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbae4b1-33f6-4adc-929c-d8f4d058667d-plugins-config-volume\") pod \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\" (UID: \"8bbae4b1-33f6-4adc-929c-d8f4d058667d\") "
Jul 29 01:52:36.147236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.147029    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" (UID: "4ade9fc6-cfe7-40a3-a91c-803e4005ad8b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:36.147236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.147128    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7135e761-acbf-455e-9654-4442c14a979b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7135e761-acbf-455e-9654-4442c14a979b" (UID: "7135e761-acbf-455e-9654-4442c14a979b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:36.147236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.147150    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.147466 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.147438    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bbae4b1-33f6-4adc-929c-d8f4d058667d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8bbae4b1-33f6-4adc-929c-d8f4d058667d" (UID: "8bbae4b1-33f6-4adc-929c-d8f4d058667d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:52:36.149056 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.149022    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-kube-api-access-rst66" (OuterVolumeSpecName: "kube-api-access-rst66") pod "4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" (UID: "4ade9fc6-cfe7-40a3-a91c-803e4005ad8b"). InnerVolumeSpecName "kube-api-access-rst66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:36.149177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.149060    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" (UID: "4ade9fc6-cfe7-40a3-a91c-803e4005ad8b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:52:36.149177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.149069    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bbae4b1-33f6-4adc-929c-d8f4d058667d-kube-api-access-zsqkf" (OuterVolumeSpecName: "kube-api-access-zsqkf") pod "8bbae4b1-33f6-4adc-929c-d8f4d058667d" (UID: "8bbae4b1-33f6-4adc-929c-d8f4d058667d"). InnerVolumeSpecName "kube-api-access-zsqkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:36.149177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.149085    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7135e761-acbf-455e-9654-4442c14a979b-kube-api-access-tww7m" (OuterVolumeSpecName: "kube-api-access-tww7m") pod "7135e761-acbf-455e-9654-4442c14a979b" (UID: "7135e761-acbf-455e-9654-4442c14a979b"). InnerVolumeSpecName "kube-api-access-tww7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:52:36.248107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.247996    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.248107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.248036    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7135e761-acbf-455e-9654-4442c14a979b-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.248107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.248048    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsqkf\" (UniqueName: \"kubernetes.io/projected/8bbae4b1-33f6-4adc-929c-d8f4d058667d-kube-api-access-zsqkf\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.248107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.248059    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rst66\" (UniqueName: \"kubernetes.io/projected/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b-kube-api-access-rst66\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.248107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.248068    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tww7m\" (UniqueName: \"kubernetes.io/projected/7135e761-acbf-455e-9654-4442c14a979b-kube-api-access-tww7m\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.248107 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.248078    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bbae4b1-33f6-4adc-929c-d8f4d058667d-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:52:36.830335 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.830295    2557 generic.go:356] "Generic (PLEG): container finished" podID="8bbae4b1-33f6-4adc-929c-d8f4d058667d" containerID="b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6" exitCode=0
Jul 29 01:52:36.830821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.830350    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"
Jul 29 01:52:36.830821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.830392    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd" event={"ID":"8bbae4b1-33f6-4adc-929c-d8f4d058667d","Type":"ContainerDied","Data":"b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6"}
Jul 29 01:52:36.830821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.830452    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd" event={"ID":"8bbae4b1-33f6-4adc-929c-d8f4d058667d","Type":"ContainerDied","Data":"9d3d526aac8dd9aa24e7dc5fede22367d47284e58a11f754746216650bb2a022"}
Jul 29 01:52:36.830821 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.830484    2557 scope.go:117] "RemoveContainer" containerID="b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6"
Jul 29 01:52:36.832064 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.831925    2557 generic.go:356] "Generic (PLEG): container finished" podID="7135e761-acbf-455e-9654-4442c14a979b" containerID="b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542" exitCode=0
Jul 29 01:52:36.832064 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.832058    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"
Jul 29 01:52:36.832231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.832067    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5" event={"ID":"7135e761-acbf-455e-9654-4442c14a979b","Type":"ContainerDied","Data":"b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542"}
Jul 29 01:52:36.832231 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.832119    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5" event={"ID":"7135e761-acbf-455e-9654-4442c14a979b","Type":"ContainerDied","Data":"27040e287c7461c69fce95c41a7fb4fb895ba1b3fa06a19d91d9951355852c61"}
Jul 29 01:52:36.834112 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.834060    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x" event={"ID":"4ade9fc6-cfe7-40a3-a91c-803e4005ad8b","Type":"ContainerDied","Data":"e3ceaf4461f47e27439054686bceb3c4934faf1488ae0e6f16ea9037b54e3381"}
Jul 29 01:52:36.834112 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.834096    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"
Jul 29 01:52:36.848414 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.844591    2557 scope.go:117] "RemoveContainer" containerID="b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6"
Jul 29 01:52:36.848414 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:52:36.845130    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6\": container with ID starting with b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6 not found: ID does not exist" containerID="b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6"
Jul 29 01:52:36.848414 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.845197    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6"} err="failed to get container status \"b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6\": rpc error: code = NotFound desc = could not find container \"b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6\": container with ID starting with b6811143453710b1e3accb14b021d8aac4f86a5616dddc427f9ccc43152f10b6 not found: ID does not exist"
Jul 29 01:52:36.848414 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.845230    2557 scope.go:117] "RemoveContainer" containerID="b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542"
Jul 29 01:52:36.860104 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.860073    2557 scope.go:117] "RemoveContainer" containerID="b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542"
Jul 29 01:52:36.860524 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:52:36.860497    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542\": container with ID starting with b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542 not found: ID does not exist" containerID="b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542"
Jul 29 01:52:36.860609 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.860536    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542"} err="failed to get container status \"b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542\": rpc error: code = NotFound desc = could not find container \"b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542\": container with ID starting with b4c002919a580d067f4ff0f91f76d105bfe5289d55f9c4af48ab7bb227246542 not found: ID does not exist"
Jul 29 01:52:36.860609 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.860560    2557 scope.go:117] "RemoveContainer" containerID="e9756bd42102b199fd25468e37c6e7cf07c4d65d7d064518af84452a357e1ff8"
Jul 29 01:52:36.872872 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.872821    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"]
Jul 29 01:52:36.882893 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.882845    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-74571164-7cd49dd5b4-sr7h5"]
Jul 29 01:52:36.916427 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.916385    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"]
Jul 29 01:52:36.920218 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.920173    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-74571164-7d44cbc78-nj87x"]
Jul 29 01:52:36.943956 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.943842    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"]
Jul 29 01:52:36.951426 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:36.951380    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-74571164-c4fc4d88b-l4jfd"]
Jul 29 01:52:37.525070 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:37.525011    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" path="/var/lib/kubelet/pods/4ade9fc6-cfe7-40a3-a91c-803e4005ad8b/volumes"
Jul 29 01:52:37.525473 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:37.525452    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7135e761-acbf-455e-9654-4442c14a979b" path="/var/lib/kubelet/pods/7135e761-acbf-455e-9654-4442c14a979b/volumes"
Jul 29 01:52:37.525830 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:52:37.525814    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bbae4b1-33f6-4adc-929c-d8f4d058667d" path="/var/lib/kubelet/pods/8bbae4b1-33f6-4adc-929c-d8f4d058667d/volumes"
Jul 29 01:54:31.111225 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111126    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"]
Jul 29 01:54:31.111868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111774    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7135e761-acbf-455e-9654-4442c14a979b" containerName="payload-pre-processing"
Jul 29 01:54:31.111868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111801    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="7135e761-acbf-455e-9654-4442c14a979b" containerName="payload-pre-processing"
Jul 29 01:54:31.111868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111826    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bbae4b1-33f6-4adc-929c-d8f4d058667d" containerName="payload-processing"
Jul 29 01:54:31.111868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111836    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bbae4b1-33f6-4adc-929c-d8f4d058667d" containerName="payload-processing"
Jul 29 01:54:31.111868 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111870    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" containerName="maas-api"
Jul 29 01:54:31.112146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111879    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" containerName="maas-api"
Jul 29 01:54:31.112146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111958    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bbae4b1-33f6-4adc-929c-d8f4d058667d" containerName="payload-processing"
Jul 29 01:54:31.112146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111975    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ade9fc6-cfe7-40a3-a91c-803e4005ad8b" containerName="maas-api"
Jul 29 01:54:31.112146 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.111986    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="7135e761-acbf-455e-9654-4442c14a979b" containerName="payload-pre-processing"
Jul 29 01:54:31.115495 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.115461    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.119356 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.119046    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7b9zw\""
Jul 29 01:54:31.119724 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.119699    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b88849d5-serving-cert\""
Jul 29 01:54:31.128544 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.128492    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"]
Jul 29 01:54:31.199444 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.199389    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1627030d-f110-428c-9259-4b22c263124c-openshift-service-ca\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.199641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.199465    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1627030d-f110-428c-9259-4b22c263124c-maas-api-tls\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.199641 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.199537    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntw2d\" (UniqueName: \"kubernetes.io/projected/1627030d-f110-428c-9259-4b22c263124c-kube-api-access-ntw2d\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.300546 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.300495    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1627030d-f110-428c-9259-4b22c263124c-openshift-service-ca\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.300741 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.300560    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1627030d-f110-428c-9259-4b22c263124c-maas-api-tls\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.300741 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.300614    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntw2d\" (UniqueName: \"kubernetes.io/projected/1627030d-f110-428c-9259-4b22c263124c-kube-api-access-ntw2d\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.301239 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.301212    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1627030d-f110-428c-9259-4b22c263124c-openshift-service-ca\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.303664 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.303623    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1627030d-f110-428c-9259-4b22c263124c-maas-api-tls\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.312249 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.312208    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntw2d\" (UniqueName: \"kubernetes.io/projected/1627030d-f110-428c-9259-4b22c263124c-kube-api-access-ntw2d\") pod \"maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.430392 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.430284    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:31.597923 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.597762    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"]
Jul 29 01:54:31.801860 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.801752    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"]
Jul 29 01:54:31.806523 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.806494    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:31.809307 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.809234    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b88849d5\""
Jul 29 01:54:31.818213 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.818175    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"]
Jul 29 01:54:31.828732 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.828683    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"]
Jul 29 01:54:31.832916 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.832878    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:31.835493 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.835451    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b88849d5-dockercfg-t7czs\""
Jul 29 01:54:31.845120 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.845084    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"]
Jul 29 01:54:31.908000 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.907938    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae5779c3-ad28-47ec-8681-e33f306e70c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:31.908000 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.907998    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j59gs\" (UniqueName: \"kubernetes.io/projected/ae5779c3-ad28-47ec-8681-e33f306e70c1-kube-api-access-j59gs\") pod \"payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:31.908310 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.908085    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-plugins-config-volume\") pod \"payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") " pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:31.908310 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:31.908126    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gdtc\" (UniqueName: \"kubernetes.io/projected/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-kube-api-access-4gdtc\") pod \"payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") " pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.008710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.008660    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae5779c3-ad28-47ec-8681-e33f306e70c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:32.008710 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.008710    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j59gs\" (UniqueName: \"kubernetes.io/projected/ae5779c3-ad28-47ec-8681-e33f306e70c1-kube-api-access-j59gs\") pod \"payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:32.009004 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.008753    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-plugins-config-volume\") pod \"payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") " pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.009004 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.008887    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gdtc\" (UniqueName: \"kubernetes.io/projected/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-kube-api-access-4gdtc\") pod \"payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") " pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.009716 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.009685    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae5779c3-ad28-47ec-8681-e33f306e70c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:32.009852 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.009685    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-plugins-config-volume\") pod \"payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") " pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.018149 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.018114    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gdtc\" (UniqueName: \"kubernetes.io/projected/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-kube-api-access-4gdtc\") pod \"payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") " pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.018340 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.018112    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j59gs\" (UniqueName: \"kubernetes.io/projected/ae5779c3-ad28-47ec-8681-e33f306e70c1-kube-api-access-j59gs\") pod \"payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:32.122361 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.122311    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:32.147072 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.147021    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.328575 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:54:32.327833    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5779c3_ad28_47ec_8681_e33f306e70c1.slice/crio-70850421e66ef077cb2813a386cc01a38596e47b99f1f69fb0ee032c06c37c82 WatchSource:0}: Error finding container 70850421e66ef077cb2813a386cc01a38596e47b99f1f69fb0ee032c06c37c82: Status 404 returned error can't find the container with id 70850421e66ef077cb2813a386cc01a38596e47b99f1f69fb0ee032c06c37c82
Jul 29 01:54:32.329496 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.329448    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"]
Jul 29 01:54:32.358394 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.357995    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"]
Jul 29 01:54:32.363099 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:54:32.363049    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b90ee04_c6ac_42b5_a840_fc7a38a853f6.slice/crio-cea3d94ce413b052b2ffbeacee927763bd2a7522ec65d88873f79bc165db78ba WatchSource:0}: Error finding container cea3d94ce413b052b2ffbeacee927763bd2a7522ec65d88873f79bc165db78ba: Status 404 returned error can't find the container with id cea3d94ce413b052b2ffbeacee927763bd2a7522ec65d88873f79bc165db78ba
Jul 29 01:54:32.467416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.467341    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj" event={"ID":"9b90ee04-c6ac-42b5-a840-fc7a38a853f6","Type":"ContainerStarted","Data":"a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779"}
Jul 29 01:54:32.467416 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.467421    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj" event={"ID":"9b90ee04-c6ac-42b5-a840-fc7a38a853f6","Type":"ContainerStarted","Data":"cea3d94ce413b052b2ffbeacee927763bd2a7522ec65d88873f79bc165db78ba"}
Jul 29 01:54:32.467714 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.467452    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:32.469687 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.469640    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb" event={"ID":"1627030d-f110-428c-9259-4b22c263124c","Type":"ContainerStarted","Data":"cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef"}
Jul 29 01:54:32.469937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.469715    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb" event={"ID":"1627030d-f110-428c-9259-4b22c263124c","Type":"ContainerStarted","Data":"573c7d92f1db59908cc13aeee09eaec93ee8b778f5f37960ac7edb9ce805e84a"}
Jul 29 01:54:32.469937 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.469746    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:32.471861 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.471817    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8" event={"ID":"ae5779c3-ad28-47ec-8681-e33f306e70c1","Type":"ContainerStarted","Data":"05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b"}
Jul 29 01:54:32.472045 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.471891    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8" event={"ID":"ae5779c3-ad28-47ec-8681-e33f306e70c1","Type":"ContainerStarted","Data":"70850421e66ef077cb2813a386cc01a38596e47b99f1f69fb0ee032c06c37c82"}
Jul 29 01:54:32.472045 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.471954    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:54:32.492762 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.492704    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj" podStartSLOduration=1.492685467 podStartE2EDuration="1.492685467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:32.491770886 +0000 UTC m=+2705.483736537" watchObservedRunningTime="2026-07-29 01:54:32.492685467 +0000 UTC m=+2705.484651135"
Jul 29 01:54:32.512280 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.512197    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb" podStartSLOduration=0.903268752 podStartE2EDuration="1.512175297s" totalImagesPullingTime="608.906545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:32.511752578 +0000 UTC m=+2705.503718245" watchObservedRunningTime="2026-07-29 01:54:32.512175297 +0000 UTC m=+2705.504141010"
Jul 29 01:54:32.533418 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:32.533350    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8" podStartSLOduration=1.5333297080000001 podStartE2EDuration="1.533329708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:32.531703372 +0000 UTC m=+2705.523669041" watchObservedRunningTime="2026-07-29 01:54:32.533329708 +0000 UTC m=+2705.525295375"
Jul 29 01:54:38.483370 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:38.483333    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:54:43.479194 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:43.479154    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:54:43.479759 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:54:43.479245    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:57:45.498010 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.497976    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"]
Jul 29 01:57:45.498711 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.498213    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb" podUID="1627030d-f110-428c-9259-4b22c263124c" containerName="maas-api" containerID="cri-o://cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef" gracePeriod=30
Jul 29 01:57:45.566637 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.566588    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"]
Jul 29 01:57:45.567548 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.567047    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj" podUID="9b90ee04-c6ac-42b5-a840-fc7a38a853f6" containerName="payload-processing" containerID="cri-o://a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779" gracePeriod=30
Jul 29 01:57:45.569762 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.569732    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"]
Jul 29 01:57:45.569960 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.569930    2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8" podUID="ae5779c3-ad28-47ec-8681-e33f306e70c1" containerName="payload-pre-processing" containerID="cri-o://05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b" gracePeriod=30
Jul 29 01:57:45.835121 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.835082    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:57:45.865593 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.865561    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:57:45.872017 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.871992    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:57:45.999369 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999300    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j59gs\" (UniqueName: \"kubernetes.io/projected/ae5779c3-ad28-47ec-8681-e33f306e70c1-kube-api-access-j59gs\") pod \"ae5779c3-ad28-47ec-8681-e33f306e70c1\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") "
Jul 29 01:57:45.999535 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999417    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntw2d\" (UniqueName: \"kubernetes.io/projected/1627030d-f110-428c-9259-4b22c263124c-kube-api-access-ntw2d\") pod \"1627030d-f110-428c-9259-4b22c263124c\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") "
Jul 29 01:57:45.999535 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999458    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1627030d-f110-428c-9259-4b22c263124c-maas-api-tls\") pod \"1627030d-f110-428c-9259-4b22c263124c\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") "
Jul 29 01:57:45.999535 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999506    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-plugins-config-volume\") pod \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") "
Jul 29 01:57:45.999700 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999628    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gdtc\" (UniqueName: \"kubernetes.io/projected/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-kube-api-access-4gdtc\") pod \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\" (UID: \"9b90ee04-c6ac-42b5-a840-fc7a38a853f6\") "
Jul 29 01:57:45.999816 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999719    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1627030d-f110-428c-9259-4b22c263124c-openshift-service-ca\") pod \"1627030d-f110-428c-9259-4b22c263124c\" (UID: \"1627030d-f110-428c-9259-4b22c263124c\") "
Jul 29 01:57:45.999816 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999768    2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae5779c3-ad28-47ec-8681-e33f306e70c1-plugins-config-volume\") pod \"ae5779c3-ad28-47ec-8681-e33f306e70c1\" (UID: \"ae5779c3-ad28-47ec-8681-e33f306e70c1\") "
Jul 29 01:57:45.999917 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:45.999860    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b90ee04-c6ac-42b5-a840-fc7a38a853f6" (UID: "9b90ee04-c6ac-42b5-a840-fc7a38a853f6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:57:46.000244 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.000210    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae5779c3-ad28-47ec-8681-e33f306e70c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae5779c3-ad28-47ec-8681-e33f306e70c1" (UID: "ae5779c3-ad28-47ec-8681-e33f306e70c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:57:46.000244 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.000227    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1627030d-f110-428c-9259-4b22c263124c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1627030d-f110-428c-9259-4b22c263124c" (UID: "1627030d-f110-428c-9259-4b22c263124c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:57:46.000418 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.000310    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.000418 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.000330    2557 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae5779c3-ad28-47ec-8681-e33f306e70c1-plugins-config-volume\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.001772 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.001752    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1627030d-f110-428c-9259-4b22c263124c-kube-api-access-ntw2d" (OuterVolumeSpecName: "kube-api-access-ntw2d") pod "1627030d-f110-428c-9259-4b22c263124c" (UID: "1627030d-f110-428c-9259-4b22c263124c"). InnerVolumeSpecName "kube-api-access-ntw2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:57:46.001843 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.001778    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-kube-api-access-4gdtc" (OuterVolumeSpecName: "kube-api-access-4gdtc") pod "9b90ee04-c6ac-42b5-a840-fc7a38a853f6" (UID: "9b90ee04-c6ac-42b5-a840-fc7a38a853f6"). InnerVolumeSpecName "kube-api-access-4gdtc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:57:46.001946 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.001929    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae5779c3-ad28-47ec-8681-e33f306e70c1-kube-api-access-j59gs" (OuterVolumeSpecName: "kube-api-access-j59gs") pod "ae5779c3-ad28-47ec-8681-e33f306e70c1" (UID: "ae5779c3-ad28-47ec-8681-e33f306e70c1"). InnerVolumeSpecName "kube-api-access-j59gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:57:46.001946 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.001932    2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1627030d-f110-428c-9259-4b22c263124c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1627030d-f110-428c-9259-4b22c263124c" (UID: "1627030d-f110-428c-9259-4b22c263124c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:57:46.101303 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.101249    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j59gs\" (UniqueName: \"kubernetes.io/projected/ae5779c3-ad28-47ec-8681-e33f306e70c1-kube-api-access-j59gs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.101303 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.101303    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntw2d\" (UniqueName: \"kubernetes.io/projected/1627030d-f110-428c-9259-4b22c263124c-kube-api-access-ntw2d\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.101478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.101314    2557 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1627030d-f110-428c-9259-4b22c263124c-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.101478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.101323    2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gdtc\" (UniqueName: \"kubernetes.io/projected/9b90ee04-c6ac-42b5-a840-fc7a38a853f6-kube-api-access-4gdtc\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.101478 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.101332    2557 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1627030d-f110-428c-9259-4b22c263124c-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 29 01:57:46.432901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.432804    2557 generic.go:356] "Generic (PLEG): container finished" podID="9b90ee04-c6ac-42b5-a840-fc7a38a853f6" containerID="a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779" exitCode=0
Jul 29 01:57:46.432901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.432851    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"
Jul 29 01:57:46.432901 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.432879    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj" event={"ID":"9b90ee04-c6ac-42b5-a840-fc7a38a853f6","Type":"ContainerDied","Data":"a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779"}
Jul 29 01:57:46.433171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.432929    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj" event={"ID":"9b90ee04-c6ac-42b5-a840-fc7a38a853f6","Type":"ContainerDied","Data":"cea3d94ce413b052b2ffbeacee927763bd2a7522ec65d88873f79bc165db78ba"}
Jul 29 01:57:46.433171 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.432951    2557 scope.go:117] "RemoveContainer" containerID="a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779"
Jul 29 01:57:46.434236 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.434214    2557 generic.go:356] "Generic (PLEG): container finished" podID="1627030d-f110-428c-9259-4b22c263124c" containerID="cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef" exitCode=0
Jul 29 01:57:46.434334 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.434279    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"
Jul 29 01:57:46.434334 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.434324    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb" event={"ID":"1627030d-f110-428c-9259-4b22c263124c","Type":"ContainerDied","Data":"cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef"}
Jul 29 01:57:46.434431 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.434364    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb" event={"ID":"1627030d-f110-428c-9259-4b22c263124c","Type":"ContainerDied","Data":"573c7d92f1db59908cc13aeee09eaec93ee8b778f5f37960ac7edb9ce805e84a"}
Jul 29 01:57:46.435846 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.435808    2557 generic.go:356] "Generic (PLEG): container finished" podID="ae5779c3-ad28-47ec-8681-e33f306e70c1" containerID="05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b" exitCode=0
Jul 29 01:57:46.435846 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.435843    2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"
Jul 29 01:57:46.436014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.435903    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8" event={"ID":"ae5779c3-ad28-47ec-8681-e33f306e70c1","Type":"ContainerDied","Data":"05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b"}
Jul 29 01:57:46.436014 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.435944    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8" event={"ID":"ae5779c3-ad28-47ec-8681-e33f306e70c1","Type":"ContainerDied","Data":"70850421e66ef077cb2813a386cc01a38596e47b99f1f69fb0ee032c06c37c82"}
Jul 29 01:57:46.444312 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.443889    2557 scope.go:117] "RemoveContainer" containerID="a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779"
Jul 29 01:57:46.444532 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:57:46.444508    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779\": container with ID starting with a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779 not found: ID does not exist" containerID="a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779"
Jul 29 01:57:46.444614 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.444544    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779"} err="failed to get container status \"a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779\": rpc error: code = NotFound desc = could not find container \"a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779\": container with ID starting with a533bd7f5c6c653875b1411c514fef8b31087325bd04c5a23fb4eb3c9e58a779 not found: ID does not exist"
Jul 29 01:57:46.444614 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.444571    2557 scope.go:117] "RemoveContainer" containerID="cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef"
Jul 29 01:57:46.453733 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.453707    2557 scope.go:117] "RemoveContainer" containerID="cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef"
Jul 29 01:57:46.454002 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:57:46.453984    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef\": container with ID starting with cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef not found: ID does not exist" containerID="cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef"
Jul 29 01:57:46.454083 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.454012    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef"} err="failed to get container status \"cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef\": rpc error: code = NotFound desc = could not find container \"cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef\": container with ID starting with cf5a633666b3d8dd8e097532fc71d8b6819d1570239f28680e55b2194578c9ef not found: ID does not exist"
Jul 29 01:57:46.454083 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.454036    2557 scope.go:117] "RemoveContainer" containerID="05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b"
Jul 29 01:57:46.462224 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.462192    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"]
Jul 29 01:57:46.462669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.462651    2557 scope.go:117] "RemoveContainer" containerID="05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b"
Jul 29 01:57:46.462933 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:57:46.462912    2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b\": container with ID starting with 05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b not found: ID does not exist" containerID="05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b"
Jul 29 01:57:46.462997 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.462943    2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b"} err="failed to get container status \"05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b\": rpc error: code = NotFound desc = could not find container \"05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b\": container with ID starting with 05d1b3aa0664040bb613bb8efe4879b5b56ea027f323ea5e3aa2f22dc1596c2b not found: ID does not exist"
Jul 29 01:57:46.467969 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.467944    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b88849d5-dc774c866-jxjlj"]
Jul 29 01:57:46.479178 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.479157    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"]
Jul 29 01:57:46.479708 ip-10-0-137-249 kubenswrapper[2557]: E0729 01:57:46.479667    2557 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1627030d_f110_428c_9259_4b22c263124c.slice/crio-573c7d92f1db59908cc13aeee09eaec93ee8b778f5f37960ac7edb9ce805e84a\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5779c3_ad28_47ec_8681_e33f306e70c1.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b90ee04_c6ac_42b5_a840_fc7a38a853f6.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1627030d_f110_428c_9259_4b22c263124c.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5779c3_ad28_47ec_8681_e33f306e70c1.slice/crio-70850421e66ef077cb2813a386cc01a38596e47b99f1f69fb0ee032c06c37c82\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b90ee04_c6ac_42b5_a840_fc7a38a853f6.slice/crio-cea3d94ce413b052b2ffbeacee927763bd2a7522ec65d88873f79bc165db78ba\": RecentStats: unable to find data in memory cache]"
Jul 29 01:57:46.485800 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.485781    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b88849d5-6c78765c49-8kgpb"]
Jul 29 01:57:46.497559 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.497531    2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"]
Jul 29 01:57:46.504465 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:46.504433    2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b88849d5-7687f88c88-mktr8"]
Jul 29 01:57:47.523553 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:47.523520    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1627030d-f110-428c-9259-4b22c263124c" path="/var/lib/kubelet/pods/1627030d-f110-428c-9259-4b22c263124c/volumes"
Jul 29 01:57:47.523966 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:47.523875    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b90ee04-c6ac-42b5-a840-fc7a38a853f6" path="/var/lib/kubelet/pods/9b90ee04-c6ac-42b5-a840-fc7a38a853f6/volumes"
Jul 29 01:57:47.524193 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:47.524180    2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae5779c3-ad28-47ec-8681-e33f306e70c1" path="/var/lib/kubelet/pods/ae5779c3-ad28-47ec-8681-e33f306e70c1/volumes"
Jul 29 01:57:53.175228 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:57:53.175194    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df5b68fbd-gzxj2_45049900-2343-41f1-8081-2f30cba7309b/authorino/0.log"
Jul 29 01:58:00.051047 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:00.051012    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-mgsnm_ffd9ce56-2f99-4635-bf6b-acef7ba8e939/copy-manifests/0.log"
Jul 29 01:58:00.059359 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:00.059327    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-mgsnm_ffd9ce56-2f99-4635-bf6b-acef7ba8e939/manager/0.log"
Jul 29 01:58:00.843801 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:00.843773    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-r65rc_2cf7590d-c5f9-42a2-ac31-0f88f10c1445/postgres/0.log"
Jul 29 01:58:02.277517 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:02.277481    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df5b68fbd-gzxj2_45049900-2343-41f1-8081-2f30cba7309b/authorino/0.log"
Jul 29 01:58:04.010201 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:04.010152    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-x8x6h_bee1fcdf-50fc-448c-aeb1-a06d507bc671/kube-auth-proxy/0.log"
Jul 29 01:58:04.267607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:04.267521    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gj62g_f1344ba6-29ab-465d-bff0-294dda5c3c9b/payload-pre-processing/0.log"
Jul 29 01:58:04.393669 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:04.393633    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7rcs8_c8dddd89-3c2d-45df-98e6-e2286c997831/payload-processing/0.log"
Jul 29 01:58:04.521566 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:04.521454    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d9b86687-ssxmq_4ad08486-9b66-4bea-ab14-3498da5c3a4d/router/0.log"
Jul 29 01:58:05.158619 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:05.158580    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-clj9j_f3735427-75c0-4f31-90dd-930f18691e72/main/0.log"
Jul 29 01:58:05.407607 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:05.407576    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9gt6k_17d449dd-fc69-4fa9-81d6-c788fd36cdae/main/0.log"
Jul 29 01:58:14.605887 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:14.605848    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rp7rc_0c8345ad-6415-492b-9916-99eb34c04ae8/global-pull-secret-syncer/0.log"
Jul 29 01:58:14.782504 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:14.782470    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sntmb_06f86dae-013a-478c-8bf0-87ee98afd542/konnectivity-agent/0.log"
Jul 29 01:58:14.835143 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:14.835112    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-249.ec2.internal_c95cbfbb4ec054ca150d39d22684fb3d/haproxy/0.log"
Jul 29 01:58:20.395289 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:20.395223    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-df5b68fbd-gzxj2_45049900-2343-41f1-8081-2f30cba7309b/authorino/0.log"
Jul 29 01:58:22.480250 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.480212    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-m9shv_20ff1210-95e5-4333-b5f1-a108f792e91a/cluster-monitoring-operator/0.log"
Jul 29 01:58:22.591842 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.591809    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54459b45f8-r4gks_49b1486a-6e84-481a-a665-23fda7a3f404/metrics-server/0.log"
Jul 29 01:58:22.741098 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.740986    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j28w8_f4911d7d-5d0b-4781-8c8b-7974644adc57/node-exporter/0.log"
Jul 29 01:58:22.762554 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.762523    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j28w8_f4911d7d-5d0b-4781-8c8b-7974644adc57/kube-rbac-proxy/0.log"
Jul 29 01:58:22.785349 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.785320    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j28w8_f4911d7d-5d0b-4781-8c8b-7974644adc57/init-textfile/0.log"
Jul 29 01:58:22.899714 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.899686    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nxx9l_0119068f-a141-446d-8b07-462fbdd773ab/kube-rbac-proxy-main/0.log"
Jul 29 01:58:22.922429 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.922399    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nxx9l_0119068f-a141-446d-8b07-462fbdd773ab/kube-rbac-proxy-self/0.log"
Jul 29 01:58:22.946890 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.946863    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nxx9l_0119068f-a141-446d-8b07-462fbdd773ab/openshift-state-metrics/0.log"
Jul 29 01:58:22.982862 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:22.982826    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/prometheus/0.log"
Jul 29 01:58:23.005908 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.005825    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/config-reloader/0.log"
Jul 29 01:58:23.028823 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.028790    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/thanos-sidecar/0.log"
Jul 29 01:58:23.051754 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.051723    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/kube-rbac-proxy-web/0.log"
Jul 29 01:58:23.109293 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.109251    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/kube-rbac-proxy/0.log"
Jul 29 01:58:23.150609 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.150582    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/kube-rbac-proxy-thanos/0.log"
Jul 29 01:58:23.182512 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.182487    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa4ba721-087f-4441-9920-1004989790c0/init-config-reloader/0.log"
Jul 29 01:58:23.305149 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.305068    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6664d46979-ngcwt_36fec6b6-d06b-4e7e-ba97-7ec1d034621a/telemeter-client/0.log"
Jul 29 01:58:23.330484 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.330453    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6664d46979-ngcwt_36fec6b6-d06b-4e7e-ba97-7ec1d034621a/reload/0.log"
Jul 29 01:58:23.361610 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.361582    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6664d46979-ngcwt_36fec6b6-d06b-4e7e-ba97-7ec1d034621a/kube-rbac-proxy/0.log"
Jul 29 01:58:23.404721 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.404686    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585dc5459f-d6wrm_ffbb0772-f706-4df2-a4f0-5e7afef956c7/thanos-query/0.log"
Jul 29 01:58:23.431374 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.431333    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585dc5459f-d6wrm_ffbb0772-f706-4df2-a4f0-5e7afef956c7/kube-rbac-proxy-web/0.log"
Jul 29 01:58:23.464314 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.464286    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585dc5459f-d6wrm_ffbb0772-f706-4df2-a4f0-5e7afef956c7/kube-rbac-proxy/0.log"
Jul 29 01:58:23.500945 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.500907    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585dc5459f-d6wrm_ffbb0772-f706-4df2-a4f0-5e7afef956c7/prom-label-proxy/0.log"
Jul 29 01:58:23.541950 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.541897    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585dc5459f-d6wrm_ffbb0772-f706-4df2-a4f0-5e7afef956c7/kube-rbac-proxy-rules/0.log"
Jul 29 01:58:23.571393 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:23.571253    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-585dc5459f-d6wrm_ffbb0772-f706-4df2-a4f0-5e7afef956c7/kube-rbac-proxy-metrics/0.log"
Jul 29 01:58:24.201553 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201514    2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"]
Jul 29 01:58:24.201913 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201897    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae5779c3-ad28-47ec-8681-e33f306e70c1" containerName="payload-pre-processing"
Jul 29 01:58:24.201967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201915    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae5779c3-ad28-47ec-8681-e33f306e70c1" containerName="payload-pre-processing"
Jul 29 01:58:24.201967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201932    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1627030d-f110-428c-9259-4b22c263124c" containerName="maas-api"
Jul 29 01:58:24.201967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201938    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1627030d-f110-428c-9259-4b22c263124c" containerName="maas-api"
Jul 29 01:58:24.201967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201950    2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b90ee04-c6ac-42b5-a840-fc7a38a853f6" containerName="payload-processing"
Jul 29 01:58:24.201967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.201955    2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b90ee04-c6ac-42b5-a840-fc7a38a853f6" containerName="payload-processing"
Jul 29 01:58:24.202123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.202020    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae5779c3-ad28-47ec-8681-e33f306e70c1" containerName="payload-pre-processing"
Jul 29 01:58:24.202123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.202032    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1627030d-f110-428c-9259-4b22c263124c" containerName="maas-api"
Jul 29 01:58:24.202123 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.202039    2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b90ee04-c6ac-42b5-a840-fc7a38a853f6" containerName="payload-processing"
Jul 29 01:58:24.205291 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.205247    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.208308 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.208285    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rr4h4\"/\"kube-root-ca.crt\""
Jul 29 01:58:24.208430 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.208323    2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rr4h4\"/\"openshift-service-ca.crt\""
Jul 29 01:58:24.208430 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.208323    2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rr4h4\"/\"default-dockercfg-vd84j\""
Jul 29 01:58:24.215910 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.215884    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"]
Jul 29 01:58:24.345371 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.345326    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-sys\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.345371 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.345372    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-lib-modules\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.345639 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.345399    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9c8k\" (UniqueName: \"kubernetes.io/projected/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-kube-api-access-f9c8k\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.345639 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.345485    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-proc\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.345639 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.345528    2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-podres\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446337 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446292    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-proc\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446337 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446345    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-podres\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446403    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-sys\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446419    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-lib-modules\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446421    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-proc\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446481    2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9c8k\" (UniqueName: \"kubernetes.io/projected/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-kube-api-access-f9c8k\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446495    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-sys\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446515    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-lib-modules\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.446562 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.446514    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-podres\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.455555 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.455482    2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9c8k\" (UniqueName: \"kubernetes.io/projected/8bf796cb-b71c-446e-bc06-1d6d7f506d9b-kube-api-access-f9c8k\") pod \"perf-node-gather-daemonset-qr8js\" (UID: \"8bf796cb-b71c-446e-bc06-1d6d7f506d9b\") " pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.516177 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.516128    2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:24.653124 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:24.653099    2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"]
Jul 29 01:58:24.655852 ip-10-0-137-249 kubenswrapper[2557]: W0729 01:58:24.655823    2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8bf796cb_b71c_446e_bc06_1d6d7f506d9b.slice/crio-473943410e3fcb7270f32a241bf908541790aa16461f4d262feb5c63316ffd51 WatchSource:0}: Error finding container 473943410e3fcb7270f32a241bf908541790aa16461f4d262feb5c63316ffd51: Status 404 returned error can't find the container with id 473943410e3fcb7270f32a241bf908541790aa16461f4d262feb5c63316ffd51
Jul 29 01:58:25.631565 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:25.631521    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js" event={"ID":"8bf796cb-b71c-446e-bc06-1d6d7f506d9b","Type":"ContainerStarted","Data":"a6f5ecfa58b992ccde877583353912836d8c9c55c21b4d7e2fc0a6cfb4df7eb8"}
Jul 29 01:58:25.631980 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:25.631593    2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js" event={"ID":"8bf796cb-b71c-446e-bc06-1d6d7f506d9b","Type":"ContainerStarted","Data":"473943410e3fcb7270f32a241bf908541790aa16461f4d262feb5c63316ffd51"}
Jul 29 01:58:25.631980 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:25.631626    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:27.569657 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:27.569602    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbjfc_e31af256-f48b-47ee-bea0-753e00ee44d0/dns/0.log"
Jul 29 01:58:27.596846 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:27.596811    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbjfc_e31af256-f48b-47ee-bea0-753e00ee44d0/kube-rbac-proxy/0.log"
Jul 29 01:58:27.735741 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:27.735713    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b2s9f_53ff96e0-5f44-4e0d-9d7d-db58f38cbc35/dns-node-resolver/0.log"
Jul 29 01:58:28.288437 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:28.288340    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-547b6b79db-5qxm2_dfbb5e8f-11b6-4a8e-b86d-edb4c84b8a10/registry/0.log"
Jul 29 01:58:28.330967 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:28.330935    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cz9m2_b9f15f19-5d1e-4223-b23b-e0a52f56af72/node-ca/0.log"
Jul 29 01:58:29.490219 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:29.490189    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-x8x6h_bee1fcdf-50fc-448c-aeb1-a06d507bc671/kube-auth-proxy/0.log"
Jul 29 01:58:29.607616 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:29.607585    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gj62g_f1344ba6-29ab-465d-bff0-294dda5c3c9b/payload-pre-processing/0.log"
Jul 29 01:58:29.636001 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:29.635973    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7rcs8_c8dddd89-3c2d-45df-98e6-e2286c997831/payload-processing/0.log"
Jul 29 01:58:29.657976 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:29.657947    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d9b86687-ssxmq_4ad08486-9b66-4bea-ab14-3498da5c3a4d/router/0.log"
Jul 29 01:58:30.363984 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:30.363954    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wk42l_1acebcd2-7200-4d28-9564-f7e74ca99209/serve-healthcheck-canary/0.log"
Jul 29 01:58:30.981734 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:30.981708    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8cdm_e3c1ad3b-3ffe-4abc-893e-3bb76981eeee/kube-rbac-proxy/0.log"
Jul 29 01:58:31.010127 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:31.010091    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8cdm_e3c1ad3b-3ffe-4abc-893e-3bb76981eeee/exporter/0.log"
Jul 29 01:58:31.038895 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:31.038869    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w8cdm_e3c1ad3b-3ffe-4abc-893e-3bb76981eeee/extractor/0.log"
Jul 29 01:58:31.646647 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:31.646618    2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js"
Jul 29 01:58:31.665015 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:31.664960    2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rr4h4/perf-node-gather-daemonset-qr8js" podStartSLOduration=7.664942965 podStartE2EDuration="7.664942965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:58:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:58:25.67209487 +0000 UTC m=+2938.664060539" watchObservedRunningTime="2026-07-29 01:58:31.664942965 +0000 UTC m=+2944.656908632"
Jul 29 01:58:33.863802 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:33.863770    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-mgsnm_ffd9ce56-2f99-4635-bf6b-acef7ba8e939/manager/0.log"
Jul 29 01:58:33.884221 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:33.884195    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d5ff8d77b-mgsnm_ffd9ce56-2f99-4635-bf6b-acef7ba8e939/copy-manifests/0.log"
Jul 29 01:58:34.430893 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:34.430804    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-x8x6h_bee1fcdf-50fc-448c-aeb1-a06d507bc671/kube-auth-proxy/0.log"
Jul 29 01:58:34.541817 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:34.541785    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gj62g_f1344ba6-29ab-465d-bff0-294dda5c3c9b/payload-pre-processing/0.log"
Jul 29 01:58:34.564968 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:34.564927    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7rcs8_c8dddd89-3c2d-45df-98e6-e2286c997831/payload-processing/0.log"
Jul 29 01:58:34.587796 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:34.587768    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d9b86687-ssxmq_4ad08486-9b66-4bea-ab14-3498da5c3a4d/router/0.log"
Jul 29 01:58:35.271366 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:35.271279    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-588fcb66d4-vx5jx_4dc9338d-2383-4670-a8a6-2f1d119127f9/manager/0.log"
Jul 29 01:58:36.002493 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:36.002463    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f844789c7-x8x6h_bee1fcdf-50fc-448c-aeb1-a06d507bc671/kube-auth-proxy/0.log"
Jul 29 01:58:36.101149 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:36.101114    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-gj62g_f1344ba6-29ab-465d-bff0-294dda5c3c9b/payload-pre-processing/0.log"
Jul 29 01:58:36.122051 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:36.122017    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-7rcs8_c8dddd89-3c2d-45df-98e6-e2286c997831/payload-processing/0.log"
Jul 29 01:58:36.136996 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:36.136963    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-57d9b86687-ssxmq_4ad08486-9b66-4bea-ab14-3498da5c3a4d/router/0.log"
Jul 29 01:58:41.509720 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.509690    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/kube-multus-additional-cni-plugins/0.log"
Jul 29 01:58:41.541427 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.541347    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/egress-router-binary-copy/0.log"
Jul 29 01:58:41.569857 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.569829    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/cni-plugins/0.log"
Jul 29 01:58:41.594307 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.594280    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/bond-cni-plugin/0.log"
Jul 29 01:58:41.622148 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.622125    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/routeoverride-cni/0.log"
Jul 29 01:58:41.648985 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.648958    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/whereabouts-cni-bincopy/0.log"
Jul 29 01:58:41.670216 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.670185    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dqtv_1ff7510b-be57-4da4-aba2-442d0b4bff26/whereabouts-cni/0.log"
Jul 29 01:58:41.865272 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.865232    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fczdg_cc406cce-394d-4c5c-a594-5b910b3ae36c/kube-multus/0.log"
Jul 29 01:58:41.935042 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.935010    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rdb8t_3e6d744d-8d4e-4697-89a2-7b343e495e0d/network-metrics-daemon/0.log"
Jul 29 01:58:41.959008 ip-10-0-137-249 kubenswrapper[2557]: I0729 01:58:41.958982    2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rdb8t_3e6d744d-8d4e-4697-89a2-7b343e495e0d/kube-rbac-proxy/0.log"